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1.1 Historical review 

Throughout history mankind has tried to control the world in which he lives. From 
the earliest days he realized that his puny strength was no match for the creatures 
around him. Tie could only survive by using his wits and cunning. His major asset 
over all other life forms on earth was his superior intelligence. Stone Age man devised 
tools and weapons from flint, stone and bone and discovered that it was possible to 
train other animals to do his bidding - and so the earliest form of control system was 
conceived. Before long the horse and ox were deployed to undertake a variety of 
tasks, including transport. It took a long time before man learned to replace animals 
with machines. 

Fundamental to any control system is the ability to measure the output of the 
system, and to take corrective action if its value deviates from some desired value. 
This in turn necessitates a sensing device. Man has a number of ‘in-built’ senses 
which from the beginning of time he has used to control his own actions, the actions 
of others, and more recently, the actions of machines. In driving a vehicle for 
example, the most important sense is sight, but hearing and smell can also contribute 
to the driver’s actions. 

The first major step in machine design, which in turn heralded the industrial 
revolution, was the development of the steam engine. A problem that faced engineers 
at the time was how to control the speed of rotation of the engine without human 
intervention. Of the various methods attempted, the most successful was the use of 
a conical pendulum, whose angle of inclination was a function (but not a linear 
function) of the angular velocity of the shaft. This principle was employed by James 
Watt in 1769 in his design of a flyball, or centrifugal speed governor. Thus possibly 
the first system for the automatic control of a machine was born. 

The principle of operation of the Watt governor is shown in Figure 1.1, where 
change in shaft speed will result in a different conical angle of the flyballs. This in 
turn results in linear motion of the sleeve which adjusts the steam mass flow-rate to 
the engine by means of a valve. 

Watt was a practical engineer and did not have much time for theoretical analysis. 
He did, however, observe that under certain conditions the engine appeared to hunt, 
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Steam 



Fig. 1.1 TheWatt centrifugal speed governor. 

where the speed output oscillated about its desired value. The elimination of hunting, 
or as it is more commonly known, instability, is an important feature in the design of 
all control systems. 

In his paper ‘On Governors’, Maxwell (1868) developed the differential equations 
for a governor, linearized about an equilibrium point, and demonstrated that stabil- 
ity of the system depended upon the roots of a characteristic equation having 
negative real parts. The problem of identifying stability criteria for linear systems 
was studied by Hurwitz (1875) and Routh (1905). This was extended to consider the 
stability of nonlinear systems by a Russian mathematician Lyapunov (1893). The 
essential mathematical framework for theoretical analysis was developed by Laplace 
(1749-1827) and Fourier (1758-1830). 

Work on feedback amplifier design at Bell Telephone Laboratories in the 1930s was 
based on the concept of frequency response and backed by the mathematics of complex 
variables. This was discussed by Nyquist (1932) in his paper ‘Regeneration Theory’, 
which described how to determine system stability using frequency domain methods. 
This was extended by Bode (1945) and N ichols during the next 1 5 years to give birth to 
what is still one of the most commonly used control system design methodologies. 

Another important approach to control system design was developed by Evans 
(1948). Based on the work of Maxwell and Routh, Evans, in his Root Locus method, 
designed rules and techniques that allowed the roots of the characteristic equation to 
be displayed in a graphical manner. 
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The advent of digital computers in the 1950s gave rise to the state-space formula- 
tion of differential equations, which, using vector matrix notation, lends itself readily 
to machine computation. The idea of optimum design was first mooted by Wiener 
(1949). The method of dynamic programming was developed by Bellman (1957), at 
about the same time as the maximum principle was discussed by Pontryagin (1962). 
At the first conference of the International Federation of Automatic Control 
(IFAC), Kalman (1960) introduced the dual concept of controllability and observ- 
ability. At the same time Kalman demonstrated that when the system dynamic 
equations are linear and the performance criterion is quadratic (LQ control), then 
the mathematical problem has an explicit solution which provides an optimal control 
law. Also Kalman and Bucy (1961) developed the idea of an optimal filter (Kalman 
filter) which, when combined with an optimal controller, produced linear-quadratic- 
Gaussian (LQG) control. 

The 1980s saw great advances in control theory for the robust design of systems 
with uncertainties in their dynamic characteristics. The work of Athans (1971), 
Safanov (1980), Chiang (1988), Grimble (1988) and others demonstrated how uncer- 
tainty can be modelled and the concept of the FIoo norm and /z-synthesis theory. 

The 1990s has introduced to the control community the concept of intelligent 
control systems. An intelligent machine according to Rzevski (1995) is one that is 
able to achieve a goal or sustained behaviour under conditions of uncertainty. 
Intelligent control theory owes much of its roots to ideas laid down in the field of 
Artificial Intelligence (AI). Artificial Neural Networks (ANNs) are composed of 
many simple computing elements operating in parallel in an attempt to emulate their 
biological counterparts. The theory is based on work undertaken by Hebb (1949), 
Rosenblatt (1961), Kohonen (1987), Widrow-Hoff (1960) and others. The concept of 
fuzzy logic was introduced by Zadeh (1965). This new logic was developed to allow 
computers to model human vagueness. Fuzzy logic controllers, whilst lacking the 
formal rigorous design methodology of other techniques, offer robust control with- 
out the need to model the dynamic behaviour of the system. Workers in the field 
include Mamdani (1976), Sugeno (1985) Sutton (1991) and Tong (1978). 


1.2 Control system fundamentals 
1 .2.1 Concept of a system 

Before discussing the structure of a control system it is necessary to define what is 
meant by a system. Systems mean different things to different people and can include 
purely physical systems such as the machine table of a Computer Numerically 
Controlled (CNC) machine tool or alternatively the procedures necessary for the 
purchase of raw materials together with the control of inventory in a Material 
Requirements Planning (MRP) system. 

However, all systems have certain things in common. They all, for example, 
require inputs and outputs to be specified. In the case of the CNC machine tool 
machine table, the input might be the power to the drive motor, and the outputs 
might be the position, velocity and acceleration of the table. For the MRP system 
inputs would include sales orders and sales forecasts (incorporated in a master 
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Outputs 


V 


Fig. 1.2 The concept of a system. 

production schedule), a bill of materials for component parts and subassemblies, 
inventory records and information relating to capacity requirements planning. Mate- 
rial requirements planning systems generate various output reports that are used in 
planning and managing factory operations. These include order releases, inventory 
status, overdue orders and inventory forecasts. It is necessary to clearly define the 
boundary of a system, together with the inputs and outputs that cross that boundary. 
In general, a system may be defined as a collection of matter, parts, components or 
procedures which are included within some specified boundary as shown in Figure 
1.2. A system may have any number of inputs and outputs. 

In control engineering, the way in which the system outputs respond in changes to 
the system inputs (i.e. the system response) is very important. The control system 
design engineer will attempt to evaluate the system response by determining a 
mathematical model for the system. Knowledge of the system inputs, together with 
the mathematical model, will allow the system outputs to be calculated. 

It is conventional to refer to the system being controlled as the plant, and this, as 
with other elements, is represented by a block diagram. Some inputs, the engineer will 
have direct control over, and can be used to control the plant outputs. These are 
known as control inputs. There are other inputs over which the engineer has no 
control, and these will tend to deflect the plant outputs from their desired values. 
These are called disturbance inputs. 

In the case of the ship shown in Figure 1.3, the rudder and engines are the control 
inputs, whose values can be adjusted to control certain outputs, for example heading 
and forward velocity. The wind, waves and current are disturbance inputs and will 
induce errors in the outputs (called controlled variables) of position, heading and 
forward velocity. In addition, the disturbances will introduce increased ship motion 
(roll, pitch and heave) which again is not desirable. 


Rudder 

Engines 

Wind 

Waves 

Current 



Position 

Forward Velocity 
Heading 
Ship Motion 
(roll, pitch, heave) 


Fig. 1.3 A ship as a dynamic system. 
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Fig. 1.4 Plant inputs and outputs. 

Generally, the relationship between control input, disturbance input, plant and 
controlled variable is shown in Figure 1.4. 


1.2.2 Open-loop systems 

Figure 1.4 represents an open-loop control system and is used for very simple 
applications. The main problem with open-loop control is that the controlled vari- 
able is sensitive to changes in disturbance inputs. So, for example, if a gas fire is 
switched on in a room, and the temperature climbs to 20 °C, it will remain at that 
value unless there is a disturbance. This could be caused by leaving a door to the 
room open, for example. Or alternatively by a change in outside temperature. In 
either case, the internal room temperature will change. For the room temperature to 
remain constant, a mechanism is required to vary the energy output from the gas fire. 


1.2.3 Closed-loop systems 

For a room temperature control system, the first requirement is to detect or sense 
changes in room temperature. The second requirement is to control or vary the energy 
output from the gas fire, if the sensed room temperature is different from the desired 
room temperature. In general, a system that is designed to control the output of a 
plant must contain at least one sensor and controller as shown in Figure 1.5. 


Desired Value 


Forward Path 


Summing 



Fig. 1.5 Closed-loop control system. 
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Figure 1.5 shows the generalized schematic block-diagram for a closed-loop, or 
feedback control system. The controller and plant lie along the forward path, and the 
sensor in the feedback path. The measured value of the plant output is compared at 
the summing point with the desired value. The difference, or error is fed to the 
controller which generates a control signal to drive the plant until its output equals 
the desired value. Such an arrangement is sometimes called an error-actuated system. 


1.3 Examples of control systems 
1.3.1 Room temperature control system 

The physical realization of a system to control room temperature is shown in Figure 
1.6. Flere the output signal from a temperature sensing device such as a thermocouple 
or a resistance thermometer is compared with the desired temperature. Any differ- 
ence or error causes the controller to send a control signal to the gas solenoid valve 
which produces a linear movement of the valve stem, thus adjusting the flow of gas to 
the burner of the gas fire. The desired temperature is usually obtained from manual 
adjustment of a potentiometer. 


Insulation 



Fig. 1.6 Room temperature control system. 


Desired 

Temperature 

► 

(°C) 


Outside 



Fig. 1.7 Block diagram of room temperature control system. 
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A detailed block diagram is shown in Figure 1.7. The physical values of the signals 
around the control loop are shown in brackets. 

Steady conditions will exist when the actual and desired temperatures are the same, 
and the heat input exactly balances the heat loss through the walls of the building. 

The system can operate in two modes: 

(a) Proportional control : Flere the linear movement of the valve stem is proportional to 
the error. This provides a continuous modulation of the heat input to the room 
producing very precise temperature control. This is used for applications where temp- 
erature control, of say better than 1 °C, is required (i.e. hospital operating theatres, 
industrial standards rooms, etc.) where accuracy is more important than cost. 

(b) On-off control'. Also called thermostatic or bang-bang control, the gas valve is 
either fully open or fully closed, i.e. the heater is either on or off. This form of 
control produces an oscillation of about 2 or 3°C of the actual temperature 
about the desired temperature, but is cheap to implement and is used for low-cost 
applications (i.e. domestic heating systems). 


1.3.2 Aircraft elevator control 


In the early days of flight, control surfaces of aircraft were operated by cables 
connected between the control column and the elevators and ailerons. Modern 
high-speed aircraft require power-assisted devices, or servomechanisms to provide 
the large forces necessary to operate the control surfaces. 

Figure 1.8 shows an elevator control system for a high-speed jet. 

Movement of the control column produces a signal from the input angular sensor 
which is compared with the measured elevator angle by the controller which generates 
a control signal proportional to the error. This is fed to an electrohydraulic servovalve 
which generates a spool-valve movement that is proportional to the control signal. 



Fig. 1.8 Elevator control system for a high-speed jet. 
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Fig. 1 .9 Block diagram of elevator control system. 


thus allowing high-pressure fluid to enter the hydraulic cylinder. The pressure differ- 
ence across the piston provides the actuating force to operate the elevator. 

Hydraulic servomechanisms have a good power/weight ratio, and are ideal for 
applications that require large forces to be produced by small and light devices. 

In practice, a ‘feel simulator’ is attached to the control column to allow the pilot to 
sense the magnitude of the aerodynamic forces acting on the control surfaces, thus 
preventing excess loading of the wings and tail-plane. The block diagram for the 
elevator control system is shown in Figure 1.9. 


1.3.3 Computer Numerically Controlled (CNC) machine tool 

Many systems operate under computer control, and Figure 1.10 shows an example of 
a CNC machine tool control system. 

Information relating to the shape of the work-piece and hence the motion of the 
machine table is stored in a computer program. This is relayed in digital format, in a 
sequential form to the controller and is compared with a digital feedback signal from 
the shaft encoder to generate a digital error signal. This is converted to an analogue 


Computer 

Controller 


Machine Table Movement 



Fig. 1.10 Computer numerically controlled machine tool. 
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Fig. 1.11 Block diagram of CNC machine-tool control system. 


control signal which, when amplified, drives a d.c. servomotor. Connected to the 
output shaft of the servomotor (in some cases through a gearbox) is a lead-screw to 
which is attached the machine table, the shaft encoder and a tachogenerator. The 
purpose of this latter device, which produces an analogue signal proportional to 
velocity, is to form an inner, or minor control loop in order to dampen, or stabilize 
the response of the system. 

The block diagram for the CNC machine tool control system is shown in Figure 1.11. 


1.3.4 Ship autopilot control system 

A ship autopilot is designed to maintain a vessel on a set heading while being 
subjected to a series of disturbances such as wind, waves and current as shown in 
Figure 1.3. This method of control is referred to as course-keeping. The autopilot can 
also be used to change course to a new heading, called course-changing. The main 
elements of the autopilot system are shown in Figure 1.12. 

The actual heading is measured by a gyro-compass (or magnetic compass in a 
smaller vessel), and compared with the desired heading, dialled into the autopilot by 
the ship’s master. The autopilot, or controller, computes the demanded rudder angle 
and sends a control signal to the steering gear. The actual rudder angle is monitored 
by a rudder angle sensor and compared with the demanded rudder angle, to form a 
control loop not dissimilar to the elevator control system shown in Figure 1.8. 

The rudder provides a control moment on the hull to drive the actual heading 
towards the desired heading while the wind, waves and current produce moments that 
may help or hinder this action. The block diagram of the system is shown in Figure 1.13. 



Fig. 1.12 Ship autopilot control system. 
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Fig. 1.13 Block diagram of ship autopilot control system. 


1.4 Summary 

In order to design and implement a control system the following essential generic 

elements are required: 

• Knowledge of the desired value : It is necessary to know what it is you are trying to 
control, to what accuracy, and over what range of values. This must be expressed 
in the form of a performance specification. In the physical system this information 
must be converted into a form suitable for the controller to understand (analogue 
or digital signal). 

• Knowledge of the output or actual value : This must be measured by a feedback 
sensor, again in a form suitable for the controller to understand. In addition, the 
sensor must have the necessary resolution and dynamic response so that the 
measured value has the accuracy required from the performance specification. 

• Knowledge of the controlling device : The controller must be able to accept meas- 
urements of desired and actual values and compute a control signal in a suitable 
form to drive an actuating element. Controllers can be a range of devices, including 
mechanical levers, pneumatic elements, analogue or digital circuits or microcomputers. 

• Knowledge of the actuating device : This unit amplifies the control signal and 
provides the ‘effort’ to move the output of the plant towards its desired value. In 
the case of the room temperature control system the actuator is the gas solenoid valve 
and burner, the ‘effort’ being heat input (W). For the ship autopilot system the 
actuator is the steering gear and rudder, the ‘effort’ being turning moment (Nm). 

• Knowledge of the plant : Most control strategies require some knowledge of the 
static and dynamic characteristics of the plant. These can be obtained from 
measurements or from the application of fundamental physical laws, or a com- 
bination of both. 


1.4.1 Control system design 

With all of this knowledge and information available to the control system designer, 
all that is left is to design the system. The first problem to be encountered is that the 
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Fig. 1.14 Steps in the design of a control system. 
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knowledge of the system will be uncertain and incomplete. In particular, the dynamic 
characteristics of the system may change with time (time-variant) and so a fixed 
control strategy will not work. Due to fuel consumption for example, the mass of an 
airliner can be almost half that of its take-off value at the end of a long haul flight. 

Measurements of the controlled variables will be contaminated with electrical 
noise and disturbance effects. Some sensors will provide accurate and reliable data, 
others, because of difficulties in measuring the output variable may produce highly 
random and almost irrelevant information. 

However, there is a standard methodology that can be applied to the design of 
most control systems. The steps in this methodology are shown in Figure 1.14. 

The design of a control system is a mixture of technique and experience. This book 
explains some tried and tested, and some more recent approaches, techniques and 
methods available to the control system designer. Experience, however, only comes 
with time. 



2 


System modelling 


2.1 Mathematical models 

If the dynamic behaviour of a physical system can be represented by an equation, or 
a set of equations, this is referred to as the mathematical model of the system. Such 
models can be constructed from knowledge of the physical characteristics of the 
system, i.e. mass for a mechanical system or resistance for an electrical system. 
Alternatively, a mathematical model may be determined by experimentation, by 
measuring how the system output responds to known inputs. 


2.2 Simple mathematical model of a motor vehicle 


Assume that a mathematical model for a motor vehicle is required, relating the accel- 
erator pedal angle 6 to the forward speed u, a simple mathematical model might be 


33 

II 

(2.1) 

Since u and 6 are functions of time, they are written u(t) and 0(t). The constant a 
could be calculated if the following vehicle data for engine torque T, wheel traction 
force F, aerodynamic drag D were available 

T = bd(t) 

(2.2) 

hi 

II 

(2.3) 

D = d u{t) 

(2.4) 

Now aerodynamic drag D must equal traction force F 



D = F 
d u(t) = cT 
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Forward 

Speed 

u(t) 

(m/s) 



Accelerator angle 6(f) (degrees) 


Fig. 2.1 Vehicle forward speed plotted against accelerator angle. 


from (2.2) 


d u(t) = cbO{t) 


giving 



m 


(2.5) 


Hence the constant for the vehicle is 


a = 



( 2 . 6 ) 


If the constants b, c and cl were not available, then the vehicle model could be 
obtained by measuring the forward speed u(t ) for a number of different accelerator 
angles 0(t) and plotting the results, as shown in Figure 2.1. 

Since Figure 2.1 shows a linear relationship, the value of the vehicle constant a is 
the slope of the line. 


2.3 More complex mathematical models 

Equation (2.1) for the motor vehicle implies that when there is a change in accelerator 
angle, there is an instantaneous change in vehicle forward speed. As all car drivers 
know, it takes time to build up to the new forward speed, so to model the dynamic 
characteristics of the vehicle accurately, this needs to be taken into account. 

Mathematical models that represent the dynamic behaviour of physical systems 
are constructed using differential equations. A more accurate representation of the 
motor vehicle would be 


e -r+f u = sd(t) 


(2.7) 


Here, du/dt is the acceleration of the vehicle. When it travels at constant velocity, this 
term becomes zero. So then 
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MO = gO(t ) 
u(t)= 

Hence ( gjf ) is again the vehicle constant, or parameter a in equation (2.1) 


(2.8) 


2.3.1 Differential equations with constant coefficients 

In general, consider a system whose output is x(t), whose input is y{t) and contains 
constant coefficients of values a, b, c,..., z. If the dynamics of the system produce a 
first-order differential equation, it would be represented as 

a ^ + bx = cy(i) (2.9) 

dr 

If the system dynamics produced a second-order differential equation, it would be 
represented by 

d 2 x dx 

a — ir + b~ + cx = ey(t) (2.10) 

dr- dr 

If the dynamics produce a third-order differential equation, its representation 
would be 


d 3 x , d 2 x dx . .. ..... 

“w +h ifi +c i; +ex = M,) <2in 

Equations (2.9), (2.10) and (2.11) are linear differential equations with constant 
coefficients. Note that the order of the differential equation is the order of the highest 
derivative. Systems described by such equations are called linear systems of the same 
order as the differential equation. For example, equation (2.9) describes a first-order 
linear system, equation (2.10) a second-order linear system and equation (2.11) a 
third-order linear system. 


2.4 Mathematical models of mechanical systems 

Mechanical systems are usually considered to comprise of the linear lumped para- 
meter elements of stiffness, damping and mass. 


2.4.1 Stiffness in mechanical systems 

An elastic element is assumed to produce an extension proportional to the force (or 
torque) applied to it. 

For the translational spring 


Force oc Extension 
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*i(Q *o(0 



P(f) P(t) 


(a) Translational Spring 
Fig. 2.2 Linear elastic elements. 


m e o(f> 



m 

(b) Rotational Spring 


If A'; (t) > x 0 {t), then 


P(t) = K(xi(t) - x 0 (t)) 


( 2 . 12 ) 


And for the rotational spring 
If 6{{t) > 0 o (t ), then 


Torque oc Twist 


m = Kmo - 0 o (O) (2.i3) 

Note that K, the spring stiffness, has units of (N/m) in equation (2.12) and (Nm/rad) 
in equation (2.13). 


2.4.2 Damping in mechanical systems 

A damping element (sometimes called a dashpot) is assumed to produce a velocity 
proportional to the force (or torque) applied to it. 

For the translational damper 

Force oc Velocity 

P(t) = Cv(t) = C^ (2.14) 

And for the rotational damper 

Torque oc Angular velocity 
df) 

T(t) = CojU) = (2.15) 


P(0 

— ► 




► v(t) 


A 



(a) Translational Damper 


(b) Rotational Damper 


Fig. 2.3 Linear damping elements. 
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Note that C, the damping coefficient, has units of (Ns/m) in equation (2.14) and 
(Nm s/rad) in equation (2.15). 


2.4.3 Mass in mechanical systems 

The force to accelerate a body is the product of its mass and acceleration (Newton’s 
second law). 

For the translational system 


Force <x Acceleration 

P(t) = mail) = m^- = X ° (2.16) 

at at 1 

For the rotational system 

Torque ex Angular acceleration 

= = (2.17) 

In equation (2.17) / is the moment of inertia about the rotational axis. 

When analysing mechanical systems, it is usual to identify all external forces by 
the use of a ‘Free-body diagram’, and then apply Newton’s second law of motion in 
the form: 

^ F = ma for translational systems 
or 

y^M = /a for rotational systems (2.18) 

Example 2. 1 

Find the differential equation relating the displacements x\(t) and x 0 (t) for the 
spring-mass-damper system shown in Figure 2.5. What would be the effect of 
neglecting the mass? 


/ 



Fig. 2.4 Linear mass elements. 
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Fig. 2.5 Spring-mass-damper system. 


K(x \-x Q ) < 


m 


► 



■* 


^■S- d d? 


Fig. 2.6 Free-body diagram for spring-mass-damper system. 


Solution 

Using equations (2.12) and (2.14) the free-body diagram is shown in Figure 2.6. 
From equation (2.18), the equation of motion is 


E 


F x = ma x 


n \ n d x ° 

K^-xJ-C— = 

,.r d".\'o d.Y 0 

Kx\ — Kx 0 = m + C 

d t- at 


Putting in the form of equation (2.10) 

m + C + Kx o = Kxi(t) (2. 1 9) 

d t- at 

Flence a spring-mass-damper system is a second-order system. 

If the mass is zero then 


K(x ; 


Z F * = ° 

Xo) - c ^ = 0 
at 

Kx ; - K: c 0 C’E 
df 


Hence 

C + Kx o = Kxi(t) 
at 

Thus if the mass is neglected, the system becomes a first-order system. 


(2.20) 
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Fig. 2.7 Flywheel in bearings. 


Example 2.2 

A flywheel of moment of inertia / sits in bearings that produce a frictional moment of 
C times the angular velocity u>(t) of the shaft as shown in Figure 2.7. Find the 
differential equation relating the applied torque T(t) and the angular velocity u)(t). 

Solution 

From equation (2.18), the equation of motion is 


'Y2 M = la 

d ui 

T{t)-Cu = I — 

I-r-+ Clo = T(t) (2.21) 


Example 2.3 

Figure 2.8 shows a reduction gearbox being driven by a motor that develops a torque 
T m (t). It has a gear reduction ratio of ‘n and the moments of inertia on the motor 
and output shafts are 7 m and I Q , and the respective damping coefficients C m and C 0 . 
Find the differential equation relating the motor torque T m (t) and the output angular 
position 9 0 (t). 



Fig. 2.8 Reduction gearbox. 
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Fig. 2.9 Free-body diagrams for reduction gearbox. 

Gearbox parameters 

I m = 5 x 10 -6 kgm 2 
I a = 0.01 kgm 2 
C m = 60 x 10~ 6 Nm s/rad 
C 0 = 0. 1 5 Nm s/rad 
w = 50:1 

Solution 

The free-body diagrams for the motor shaft and output shaft are shown in Figure 2.9. 
Equations of Motion are 

(1) Motor shaft 

T.r _ T 
2 ^ M ~ Im 

T m ( t )-C m d ^-aXU) = I m d ^ 
re-arranging the above equation, 

= (2.22) 


E M = / < 


d 2 e m 

d t 2 


bX(t) - Co 


d0o 

dt 


= 'o 


d 2 e 0 

dt 2 


(2) Output shaft 
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re-arranging the above equation. 


X) b\ lo dt 2+Co dt 


(2.23) 


Equating equations (2.22) and (2.23) 

-(t (t) - I d "' 9m - C — 

l 1 mw - z m , 7 , 

a \ at 1 at 


1 1 O , T I '-'O 1 

d? 2 d? 


Kinematic relationships 


- = n 0 m (t) = nd 0 (t) 


d 9 m _ dd 0 
~dt~ ~ n ~dt 


dt 2 


= n 


df- 


Hence 


l T rA T d20 ° ^ d9 < 

T m (t) w/ m ^ 2 ^ 


= /, 


d z e 0 

dt 2 


giving the differential equation 


d 2 0 o 


dO n 


c ° d/ J 


(/o + » 2 / m ) + (Co + n 2 C m ) = »r m (0 


(2.24) 


The terms (. I 0 + n 2 I m ) and (C 0 + n 2 C m ) are called the equivalent moment of inertia / e 
and equivalent damping coefficient C e referred to the output shaft. 

Substituting values gives 

I e = (0.01 + 50 2 x 5 x 10~ 6 ) = 0.0225 kgm 2 
C e = (0.15 + 50 2 x 60 x 10~ 6 ) = 0.3 Nm s/rad 

From equation (2.24) 


0.0225 ^ + 0.3 ^ = 50 T m (t) 
at 2 at 


(2.25) 


2.5 Mathematical models of electrical systems 

The basic passive elements of electrical systems are resistance, inductance and capa- 
citance as shown in Figure 2.10. 
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R 

MO 

► /■( 0 

(a) Resistance 


MO 


► '(0 

(b) Inductance 

MO | |_C vJJ) 

► /(0 

(c) Capacitance 

Fig. 2.10 Passive elements of an electrical system. 

For a resistive element, Ohm’s Law can be written 

(vi (t) - v 2 (t)) = Ri(t) (2.26) 

For an inductive element, the relationship between voltage and current is 

(v,(f) - V2(f)) = (2.27) 

For a capacitive element, the electrostatic equation is 

Q(t) = C( V] (t) - V2(0) 

Differentiating both sides with respect to t 

f =/ ( 0=cA( Vi (0-V 2 (0) (2.28) 

Note that if both sides of equation (2.28) are integrated then 

(vt(0 - V2(0) = idt (2.29) 

Example 2.4 

Find the differential equation relating v\(t) and v 2 (?) for the RC network shown in 
Figure 2.11. 


Solution 

From equations (2.26) and (2.29) 

vi(0 - v 2 (0 = Ri{t) 
nit) =-^J idt 


(2.30) 
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Fig. 2.11 RC network, 
or 

d\h 

C J = /(/) (2.31) 

substituting (2.31) into (2.30) 

vi(0 - V2(0 = RC ^ (2.32) 

Equation (2.32) can be expressed as a first-order differential equation 

RC d ^+v 2 = v l (t) (2.33) 

d? 

Example 2.5 

Find the differential equations relating v\{t) and v 2 (t) for the networks shown in 
Figure 2.12. 


v) (0 



v 2 {f) 


(a) 


'l(0 + , 2( f ) Ftj R 2 




i 

k 1 


'l (f) 

C,= 

r 


i/ 3 (0 / 2 (f) C, = 

r 





(b) 


Fig. 2.12 Electrical networks. 
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Solution for Network (a) Figure 2.12 
From equations (2.26), (2.27) and (2.29) 


d i 

vi (t) - v 2 (t ) = Ri(t) + L — 
at 


v 2 (t ) = c I idt 


or 


dv? 


substituting (2.35) into (2.34) 


or 


MO -, 2 (,) = RC l ki + L2(c^f 


dv ? d“v? 

Mt)-Ht) = RC^ + LC^ 


Equation (2.36) can be expressed as a second-order differential equation 

d 2 v? dv? 

LC d/ + * C d7 + V2 = VlW 

Solution for Network (b) Figure 2.12 
System equations 


vi(0 - v 3 (0 = R\(i\(t) + hit)) 


1 f dv? 

v 3 (t) = - / hdt or C\ — = h(t) 


v 3 (<) - v 2 (0 = ^2/2(0 


1 /' dv 2 

V 2 (0 = I hdt or C 2 = i 2 (0 


From equation (2.40) 


v 3 (0 = ^ 2 / 2(0 + v 2 (0 


(2.34) 


(2-35) 


(2.36) 

(2.37) 

(2.38) 

(2.39) 

(2.40) 

(2.41) 


Substituting for fit) using equation (2.41) 
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Hence from equations (2.42) and (2.39) 

h(t) = C\ — j.R 2 C 2 -^ + TzW 
d 2 v? dr? 

Substituting equations (2.41), (2.42) and (2.43) into equation (2.38) 


f dv 2 1 f d~v 2 

vi(t)-lR 2 C 2 ^ + v 2 (t)[ =rAr 2 C 1 C 2 ^ 

which produces the second-order differential equation 


dv 2 dv 2 

Cl d7 +C2 ^7 


C 2 ^ + ( R \ C, + Ri C 2 + R 2 C 2 ) ^ + v 2 = vi(t) 


(2.43) 


(2.44) 


2.6 Mathematical models of thermal systems 

It is convenient to consider thermal systems as being analogous to electrical systems 
so that they contain both resistive and capacitive elements. 


2.6.1 Thermal resistance Rj 

Heat flow by conduction is given by Fourier’s Law 

„ KA(0 1 - 0 2 ) 
q t = 2 

The parameters in equation (2.45) are shown in Figure 2.13. They are 
(9 1 — 02 ) = Temperature differential (K) 

A = Normal cross sectional area (m 2 ) 

£ = Thickness (m) 

K = Thermal conductivity (W/mK) 

Q t = Heat flow (J/s = W) 





(2.45) 


Fig. 2.13 Heat flow through a flat plate. 
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Equation (2.45) can be written in the same form as Ohm’s Law (equation (2.26)) 

(0i(O-02(O) = *t0t(O (2.46) 

where Rj is the thermal resistance and is 


Rj — 


i 

KA 


(2.47) 


2.6.2 Thermal capacitance C T 

The heat stored by a body is 

H(t) = mCp8(t ) (2.48) 

where 

H = Heat (J) 
m = Mass (kg) 

C p = Specific heat at constant 
pressure (J/kgK) 

9 = Temperature rise (K) 

If equation (2.48) is compared with the electrostatic equation 

0(0 = Cv(t) (2.49) 

then the thermal capacitance Cj is 

C T = mC p (2.50) 

To obtain the heat flow 0x, equation (2.48) is differentiated with respect to time 


d H 
d t 


= mCp 


de 

d t 


or 

df) 

0t(O = Ct 


(2.51) 


(2.52) 


Example 2.6 

Heat flows from a heat source at temperature 9\{t) through a wall having ideal 
thermal resistance Rj to a heat sink at temperature O 2 U) having ideal thermal 
capacitance Cj as shown in Figure 2.14. Find the differential equation relating 
9 \ (0 and 0 2 {t). 


0t(O 


( 01 ( 0 - 02 ( 0 ) 

Rj 


Solution 

(1) Wall: From equation (2.46) 


(2.53) 
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Wall 



Fig. 2.14 Heat transfer system. 

(2) Heat sink: From equation (2.52) 

Q T(t ) = C J d ^ (2.54) 

Equating equations (2.53) and (2.54) 

( 01 ( 0 - 02 ( 0 ) ., ^ d02 
R t t At 

Re-arranging to give the first-order differential equation 

*tCt^+0 2 = 0i(O (2-55) 


2.7 Mathematical models of fluid systems 

Like thermal systems, it is convenient to consider fluid systems as being analogous to 
electrical systems. There is one important difference however, and this is that the 
relationship between pressure and flow-rate for a liquid under turbulent flow condi- 
tions is nonlinear. In order to represent such systems using linear differential equa- 
tions it becomes necessary to linearize the system equations. 


2.7.1 Linearization of nonlinear functions for small 
perturbations 

Consider a nonlinear function Y = f(x) as shown in Figure 2.15. Assume that it is 
necessary to operate in the vicinity of point a on the curve (the operating point) 
whose co-ordinates are X a ,Y a . 

For the small perturbations AX and AT about the operating point a let 


AT = i 
A Y = y 


(2.56) 
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If the slope at the operating point is 


d Y 
dX 


a 


then the approximate linear relationship becomes 


y = 


d7 

dX 


(2.57) 


Example 2.7 

The free-body diagram of a ship is shown in Figure 2.16. It has a mass of 15 x 10 6 kg 
and the propeller produces a thrust of K„ times the angular velocity n of the propeller, 
K n having a value of 1 10 x 10 3 Ns/rad. The hydrodynamic resistance is given by the 
relationship R = C v V 2 , where C v has a value of 10,000 Ns 2 /m 2 . Determine, using 
small perturbation theory, the linear differential equation relating the forward speed 
v(t) and propeller angular velocity n(t) when the forward speed is 7.5 m/s. 


Solution 

Linearize hydrodynamic resistance equation for an operating speed V a of 7.5 m/s. 

R=C v V 2 

5F = 2c * f 


d R 
dV 

d R 
dV 


= 2 C v V a 

= 2 x 10000 x 7.5 
= C = 150 000 Ns/m 



Fig. 2.15 Linearization of a nonlinear function. 
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Fig. 2.16 Free-body diagram of ship. 


Hence the linear relationship is 

R = 

Using Newton’s second law of motion 

T — R = 

K„n — Cv = m ^ 
at 

dv 

m — + Cv = K„n 
d t 


Cv 

ma x 

dv 
in — 


(2.58) 


(2.59) 


Substituting values gives 

(15 x 10 6 )^ + (150 x 10 3 )v = (110 x 10 3 )«(?) (2.60) 

d t 

Example 2.8 

In Figure 2.17 the tank of water has a cross-sectional area A , and under steady 
conditions both the outflow and inflow is V a and the head is H a . 


(a) Under these conditions find an expression for the linearized valve resistance R[ 
given that flow through the valve is 


V = A v Cd\/2gH 1 


where 

V = volumetric flow-rate (m 3 /s) 

A v = valve flow area (m 2 ) 

Cd = coefficient of discharge 
g = acceleration due to gravity (m/s 2 ) 
H = head across the valve (m) 
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(b) If the steady value of the head //„ is 1.5 m, what is the valve resistance Rf when 

A v = 15 x 1(T 3 nr 
g = 9.81 m/s 2 
C d = 0.6 

(c) If the inflow now increases an amount v\ producing an increase in head h and an 
increase in outflow V 2 , find the differential equation relating v\ and V 2 when the 
tank cross-sectional area A is 0.75m 2 . 

Solution 

(a) Flow through the valve is given by 


V=A v C d ^2gH 


now 


dV 

dH 

dV 

dH 


a 


a 


A v C d (2g) 112 x 0.5H; 1/2 



The linearized relationship is 


hence 


h = R[V2 



(2.61) 


'4+ 


//|\ x 




zz 


R, 


//l\\ 


v a + Vo 


Fig. 2.17 Tank and valve system. 


System modelling 31 


(b) Inserting values gives 


1 


Rf 15 x 10- 3 x 0.6 V 9.81 
R[ = 61.45 s/m 2 


2 x 1.5 


(c) Tank (Continuity Equation) 


dh 

Inflow — Outflow = A — 
d t 

{V a + Vi) — (V a + V 2 ) = A — 

d t 

dh 

vi - v 2 = A — 
dt 


Valve (Linearized Equation) 


and 


h = R(V 2 


dh n dv ’2 
~r = R[ —7— 
dt dt 


Substituting equation (2.64) into equation (2.63) 

, „ dV2 
vi - v 2 = ARf ——— 
d 1 


giving 


Inserting values gives 


dv-> 

AR[-^-+v 2 = v\(t) 


46.09 + V 2 = vi (?) 

dt 


(2.62) 


(2.63) 


(2.64) 


(2.65) 


(2.66) 


2.8 Further problems 

Example 2.9 

A solenoid valve is shown in Figure 2.18. The coil has an electrical resistance of 4fi, 
an inductance of 0.6 H and produces an electromagnetic force F c (t) of K c times the 
current i(t). The valve has a mass of 0.125 kg and the linear bearings produce 
a resistive force of C times the velocity u(t). The values of K c and C are 0.4 N/A 
and 0.25 Ns/m respectively. Develop the differential equations relating the voltage 
v(t) and current i(t) for the electrical circuit, and also for the current i(t) and velocity 
u(t) for the mechanical elements. Hence deduce the overall differential equation 
relating the input voltage v(t) to the output velocity u(t). 
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FM 


Fig. 2.18 Solenoid valve. 


Solution 


L t, +Ri = ,{ 0 

d u 

m — + Cu = K c i(t) 
at 


d 1 u d u 

0.075 — + 0.65 — + u = 0.4v(0 
At 1 At 


Example 2.10 

The laser-guided missile shown in Figure 2.19 has a pitch moment of inertia of 
90kgm 2 . The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle (i(t). The fin positional control system is described 
by the differential equation 

0.2^ +m = u(t ) 

where «(/) is the control signal. Determine the differential equation relating the 
control signal u{t) and the pitch angle 9{t). 


Solution 


A 3 6 A 2 6 

d^ +5 d?2 


20u(t) 



Fig. 2.19 Laser-guided missile. 
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Fig. 2.20 Torsional spring-mass-damper system. 


Example 2.11 

A torsional spring of stiffness K, a mass of moment of inertia I and a fluid damper 
with damping coefficient C are connected together as shown in Figure 2.20. If the 
angular displacement of the free end of the spring is 9 x {t) and the angular displace- 
ment of the mass and damper is 9 a (t), find the differential equation relating 9\{t) and 
9 0 (t) given that 

I = 2.5 kg nr 
C = 12.5 Nm s/rad 
K = 250 Nm/rad 


Solution 

a2q aq 

2.5--^+ 12.5— -+25O0 o = 25O0i(O 
at 1 at 

Example 2.12 

A field controlled d.c. motor develops a torque T m (t) proportional to the field current 
if(t). The rotating parts have a moment of inertia / of 1.5 kg m 2 and a viscous 
damping coefficient C of 0.5 Nm s/rad. 

When a current of 1.0 A is passed through the field coil, the shaft finally settles 
down to a steady speed ui Q (t) of 5 rad/s. 

(a) Determine the differential equations relating i[(t) and ujt). 

(b) What is the value of the coil constant K c , and hence what is the torque developed 
by the motor when a current of 0.5 A flows through the field coil? 

Solution 

(a) /^ + Cw 0 = K c i f (t) 

at 

(b) K c = 2.5 Nm/A. T m = 1 .25 Nm 


34 Advanced Control Engineering 


MO 



MO 


Fig. 2.21 Passive RC network. 


Oven 



MO 


Fig. 2.22 Drying oven. 


Example 2.13 

Figure 2.21 shows a passive electrical network. Determine the differential equation 
relating vi(?) and V 2 (/). 


Solution 


R< 


r dv2 

d? 


+ 




V 2 = Vi(0 


Example 2.14 

A drying oven which is constructed of firebrick walls is heated by an electrically 
operated gas burner as shown in Figure 2.22. The system variables and constants are 


v\{t) = burner operating voltage (V) 

Qi(t) = heat input to oven (W) 

0„(l) = internal oven temperature (K) 

9 s (t ) = temperature of surroundings (K) 

K = burner constant = 2000W/V 
R T = thermal resistance of walls = 0.5 x 10 _3 min K/J 
Cj = oven thermal capacitance = 1 x 10 4 J/K 

Find the differential equation relating v;(z), 0 o (t ) and 9 s (t). 


Solution 


Time domain analysis 


3.1 introduction 


The manner in which a dynamic system responds to an input, expressed as a function 
of time, is called the time response. The theoretical evaluation of this response is said 
to be undertaken in the time domain, and is referred to as time domain analysis. It is 
possible to compute the time response of a system if the following is known: 

• the nature of the input(s), expressed as a function of time 

• the mathematical model of the system. 

The time response of any system has two components: 

(a) Transient response : This component of the response will (for a stable system) 
decay, usually exponentially, to zero as time increases. It is a function only of the 
system dynamics, and is independent of the input quantity. 

(b) Steady-state response : This is the response of the system after the transient 
component has decayed and is a function of both the system dynamics and the 
input quantity. 



Fig. 3.1 Transient and steady-state periods of time response. 
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The total response of the system is always the sum of the transient and steady-state 
components. Figure 3.1 shows the transient and steady-state periods of time 
response. Differences between the input function x,(t) (in this case a ramp function) 
and system response x Q (t) are called transient errors during the transient period, and 
steady-state errors during the steady-state period. One of the major objectives of 
control system design is to minimize these errors. 


3.2 Laplace transforms 

In order to compute the time response of a dynamic system, it is necessary to solve 
the differential equations (system mathematical model) for given inputs. There are 
a number of analytical and numerical techniques available to do this, but the one 
favoured by control engineers is the use of the Laplace transform. 

This technique transforms the problem from the time (or t) domain to the Laplace 
(or s ) domain. The advantage in doing this is that complex time domain differential 
equations become relatively simple s domain algebraic equations. When a suitable 
solution is arrived at, it is inverse transformed back to the time domain. The process 
is shown in Figure 3.2. 

The Laplace transform of a function of time/(t) is given by the integral 



(3.1) 


where 5 is a complex variable a ± jw and is called the Laplace operator. 


s Domain F(s) 


Laplace 

Transform 


> Algebraic 
equations 


2W)] = F(s) 


Inverse 

Laplace 

Transform 


S-\F(s)] = f(t) 


Time Domain f(t) 

Differential 

equations 


Fig. 3.2 The Laplace transform process. 
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3.2.1 Laplace transforms of common functions 

Example 3.1 

f{t ) = 1 (called a unit step function). 


Solution 

From equation (3.1) 


Example 3.2 


,r|/in| = Fivi= / ie-"d i 




Jo 


--( 0 - 1 ) 

5 


/(0 = e- 


w(0]=^>= r 

J o 


e~ a, e-' r d r 


-o+^d t 


(3.2) 


1 


5 + 0 

1 

5 + 0 


(e' ( ' +fl)r ) 

( 0 - 1 ) 


J o 


1 


5 + 0 


(3.3) 


Table 3.1 gives further Laplace transforms of common functions (called Laplace 
transform pairs). 


3.2.2 Properties of the Laplace transform 

(a) Derivatives: The Laplace transform of a time derivative is 

^/(0 = s n F(s) -f{0)s"-' -/'(0)5"- 2 - • • • (3.4) 

where /(0),/'(0) are the initial conditions, or the values of/(r), d/d t f(t) etc. at t = 0 

(b) Linearity 


n.m ±f 2 (t)\ = F\(s) ± f 2 (s) 


(3.5) 
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Table 3.1 Common Laplace transform pairs 


Time function f(t) 

Laplace transform £T[f{t)\ — F(s) 

i 

unit impulse S(t) 

i 

2 

unit step 1 

l/s 

3 

unit ramp r 

1// 

4 

t" 

n\ 

S n + 1 

5 

e - " 

1 

(5 + a) 

6 

1 - e~ al 

a 

s(s + a) 

7 

sintu? 

UJ 

S 2 + UJ 2 

8 

coste/ 

S 

S 2 + UJ 2 

9 

e _<! ' sin ter 

UJ 

(.V + af + te 2 

10 

e~ a '(cos ter — — sin ter) 
te 

s 

(s + a) 2 + te 2 


(c) Constant multiplication 


JF[af{t)\ = aF(s) 


(d) Real shift theorem 


J F[f(t - D] = e~ Ts F(s) for T > 0 


(e) Convolution integral 


~ T)d t = Fi(s)F 2 (s) 


(f) Initial value theorem 

/(0) = I ini [/(/)] = lim [sF(s)] 

t—>0 s — >oo 

(g) Final value theorem 

/( oo) = lim [f(t)] = lim[sF(s)] 

t—KX) £— >■ 0 


(3.6) 

(3.7) 

(3.8) 

(3.9) 

(3.10) 


3.2.3 Inverse transformation 

The inverse transform of a function of 5 is given by the integral 

i rcr+}uj 

fit) = £?~ l [F{s)\ = — / F{sY’As (3.11) 

2ttj J a _ jw 
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In practice, inverse transformation is most easily achieved by using partial fractions 
to break down solutions into standard components, and then use tables of Laplace 
transform pairs, as given in Table 3.1. 


3.2.4 Common partial fraction expansions 

(i) Factored roots 

K A B 

s(s + a) s (s + a) 

(ii) Repeated roots 

K A B C 

s 2 {s + a) s s 2 + (s + a) 

(iii) Second-order real roots ( b 2 > 4 ac) 


(3.12) 


(3.13) 


K 

s(as 2 + bs + c) 


K 

s(s + d)(s + e ) 


A B C 

s + (s + d ) + (s + e) 


(iv) Second-order complex roots ( b 2 < 4 ac) 

K _ A Bs + C 
s(as 2 + bs + c) s as 2 + bs + c 

Completing the square gives 

A Bs+C 
s (s + a) 2 + ur 

Note: In (iii) and (iv) the coefficient a is usually factored to a unity value. 


(3.14) 


3.3 Transfer functions 

A transfer function is the Laplace transform of a differential equation with zero 
initial conditions. It is a very easy way to transform from the time to the s domain, 
and a powerful tool for the control engineer. 

Example 3.3 

Find the Laplace transform of the following differential equation given: 

(a) initial conditions x a = 4, dx 0 /dt = 3 

(b) zero initial conditions 


d 2 


*0 , dxp 

d t 2 d t 


2x 0 = 5 
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*i(s) 


XJ.s) 


► 


G(s) 


► 


Fig. 3.3 The transfer function approach. 

Solution 

(a) Including initial conditions : Take Laplace transforms (equation (3.4), Table 3.1). 



5 + As 1 + 1 5s 


(, s 2 + 3s + 2)X a (s ) 



(3.15) 


(b) Zero initial conditions 
At t = 0, x a = 0, dx a /dt = 0. 


Take Laplace transforms 



s i X 0 (s) + 3LL 0 (y> + 2 X Q (s) 


(3.16) 


Example 3.3(b) is easily solved using transfer functions. Figure 3.3 shows the general 
approach. In Figure 3.3 

• Tj(.y) is the Laplace transform of the input function. 

• T" 0 (^) is the Laplace transform of the output function, or system response. 

• G(s ) is the transfer function, i.e. the Laplace transform of the differential equation 
for zero initial conditions. 

The solution is therefore given by 


X 0 (s) = G(s)Xi(s) 


(3.17) 


Thus, for a general second-order transfer function 



(as 2 + bs + c)Ao(^) = KXi(s) 


Hence 
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m 

K 

Us) 


as+bs+c 



Fig. 3.4 General second-order transfer function. 


x;(s)=5 Is 

1 

Us) 


s 2 +3s+2 



Fig. 3.5 Example 3.3(b) expressed as a transfer function. 


Comparing equations (3.17) and (3.18), the transfer function G(s) is 


G(s) 


K 

as 2 + bs + c 


(3.19) 


which, using the form shown in Figure 3.3, can be expressed as shown in Figure 3.4. 

Returning to Example 3.3(b), the solution, using the transfer function approach is 
shown in Figure 3.5. From Figure 3.5 


X 0 (s) 


5 

4CT37T2) 


(3.20) 


which is the same as equation (3.16). 


3.4 Common time domain input functions 
3.4.1 The impulse function 

An impulse is a pulse with a width At — > 0 as shown in Figure 3.6. The strength of an 
impulse is its area A, where 

A = height h x At. (3.21) 

The Laplace transform of an impulse function is equal to the area of the function. 
The impulse function whose area is unity is called a unit impulse 8{t). 


3.4.2 The step function 

A step function is described as x\(t) = B\ Xi(s) = B/s for t > 0 (Figure 3.7). For a unit 
step function x-^t) = 1; X\ (s) = I Is. This is sometimes referred to as a ‘constant 
position’ input. 
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Impulse 



Fig. 3.6 The impulse function. 


*i(?) 


B 


t 


Fig. 3.7 The step function. 


3.4.3 The ramp function 

A ramp function is described as x\{t) = Qt; X[{s ) = Q/s 2 for t > 0 (Figure 3.8). For a 
unit ramp function x\(t) = t; X\(s) = l/s 2 . This is sometimes referred to as a ‘constant 
velocity’ input. 


3.4.4 The parabolic function 

A parabolic function is described as x;(f) = Kt 2 ; T)(,s) = 2 K/s 2 for t > 0 (Figure 3.9). 
For a unit parabolic function Xi(f) = t 2 ; T)(.s) = 2/s 2 . This is sometimes referred to as 
a ‘constant acceleration’ input. 
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t 


Fig. 3.8 The ramp function. 



Fig. 3.9 The parabolic function. 


3.5 Time domain response of first-order systems 
3.5.1 Standard form 

Consider a first-order differential equation 

a + bx Q = cxi(t) (3.22) 

at 

Take Laplace transforms, zero initial conditions 


asX 0 (s ) + bX Q (s) = cXi(s) 
(as + b)X Q (s) = cX{(s) 
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The transfer function is 


G(s) 


Xo 


(s) 


c 

as + b 


To obtain the standard form, divide by b 


G(s) 


C 

b 


1+5* 


which is written 


G(s) 


K 

1 + Ts 


(3.23) 


Equation (3.23) is the standard form of transfer function for a first-order system, 
where K = steady-state gain constant and T = time constant (seconds). 


3.5.2 Impulse response of first-order systems 

Example 3.4 (See also Appendix 1, examp34.m ) 

Find an expression for the response of a first-order system to an impulse function of 
area A. 


Solution 

From Figure 3.10 


or 


, AK AK/T 
Xo( ' V) " 1 + Ts ~ {s+l/T) 


X 0 {s) 


T \(s + a)) 


(3.24) 


(3.25) 


Equation (3.25) is in the form given in Laplace transform pair 5, Table 3.1, so the 
inverse transform becomes 



—at 



(3.26) 


The impulse response function, equation (3.26) is shown in Figure 3.11. 


X|(s)=/4 


A 

K 

X 0 (s) 


1 + Ts 



Fig. 3.10 Impulse response of a first-order system. 
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*o(f) 



Fig. 3.11 Response of a first-order system to an impulse function of area A. 


3.5.3 Step response of first-order systems 

Example 3.5 (See also Appendix 1, examp35.ni) 

Find an expression for the response of a first-order system to a step function of 
height B. 

Solution 

From Figure 3.12 



(3.27) 


Equation (3.27) is in the form given in Laplace transform pair 6 Table 3.1, so the 
inverse transform becomes 



(3.28) 


If B = 1 (unit step) and K = 1 (unity gain) then 



(3.29) 


When time t is expressed as a ratio of time constant T, then Table 3.2 and Figure 3.13 
can be constructed. 

Table 3.2 Unit step response of a first-order system 


t/T 0 0.25 0.5 0.75 1 

x Q (t) 0 0.221 0.393 0.527 0.632 


1.5 2 2.5 3 4 

0.770 0.865 0.920 0.950 0.980 
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X,(s)=B/s 


* 


K 

1 + Ts 


* X 0 (s) 


Fig. 3.12 Step response of a first-order system. 

3.5.4 Experimental determination of system time constant 
using step response 

Method one\ The system time constant is the time the system takes to reach 63.2% of 
its final value (see Table 3.2). 

Method two : The system time constant is the intersection of the slope at t = 0 with 
the final value line (see Figure 3.13) since 

x 0 (t ) = 1 - e~ t/T 

< £=°-(4>-" r =k /r < 3 -»> 

d ^° Lo = ^ att = 0 (3.31) 

This also applies to any other tangent, see Figure 3.13. 



Fig. 3.13 Unit step response of a first-order system. 
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3.5.5 Ramp response of first-order systems 

Example 3.6 

Find an expression for the response of a first-order system to a ramp function of 
slope Q. 


Solution 

From Figure 3.14 


Xo{s) = 


QK 

5 2 (1 + Ts) 


QK/T 

s 2 (s+l/T) 


A B C 
7 + 7 + Q+ \/T) 


(3.32) 


(See partial fraction expansion equation (3.13)). Multiplying both sides by 
s 2 (s + 1 /T), we get 




+ B 



+ Cs 2 


QK A 2 A „ B „ , 
i.e. ^ = As 1 +-s + Bs + -+Cs 2 

Equating coefficients on both sides of equation (3.33) 


(r): 

0 = 

A + C 

A 

(7): 

0 = 

t + b 

(*°): 

QK 

B 

T 

~T 


From (3.34) 


From (3.36) 


C = —A 


Substituting into (3.35) 
FLence from (3.34) 


B = QK 

yf = -QKT 


C= QKT 


(3.33) 

(3.34) 

(3.35) 

(3.36) 


7((s)=0/s 2 

K 



1 + Ts 



Fig. 3.14 Ramp response of a first-order system (see also Figure A1.1). 
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Number of Time Constants 


Fig. 3.15 Unit ramp response of a first-order system. 


Inserting values of A, B and C into (3.32) 


X 0 (s) 


QKT | QK | QKT 

— V + + (s+l/f) 


Inverse transform, and factor out KQ 


(3.37) 


x 0 (t) = KQ(t-T+ re-/") (3.38) 

If Q = 1 (unit ramp) and K = 1 (unity gain) then 

x a (t) = t- T+ 7e- /r (3.39) 

The first term in equation (3.39) represents the input quantity, the second is the 
steady-state error and the third is the transient component. When time t is expressed 
as a ratio of time constant T, then Table 3.3 and Figure 3.15 can be constructed. In 
Figure 3.15 the distance along the time axis between the input and output, in the 
steady-state, is the time constant. 


Table 3.3 Unit ramp response of a first-order system 


t/T 0 1 2 3 4 5 6 7 

xi (t)/T 0 1 2 3 4 5 6 7 

x a (t)/T 0 0.368 1.135 2.05 3.018 4.007 5 6 
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3.6 Time domain response of second-order systems 
3.6.1 Standard form 

Consider a second-order differential equation 

d 2 .\'r, d.\' n 

a — -^ + b— — I- cx 0 = ex \ (?) (3.40) 

d?- d? 

Take Laplace transforms, zero initial conditions 

as 2 X 0 (s) + bsX 0 (s) + cX 0 (s) = eX\ (s) 

(as 2 + bs + c)X 0 (s ) = eXi(s) (3.41) 


The transfer function is 


G(s)=^-(s) = 


Xi ‘ as 2 + bs + c 

To obtain the standard form, divide by c 


G(s) = 


-s 2 + -s + 1 


which is written as 


G(s) 


K 


Xs 1 + 1 


This can also be normalized to make the s 2 coefficient unity, i.e. 


G(s) 


Kuj 


2 

n 


S 2 + 2 (ul n s + Lul 


(3.42) 


(3.43) 


Equations (3.42) and (3.43) are the standard forms of transfer functions for a second- 
order system, where K = steady-state gain constant, ui n = undamped natural 
frequency (rad/s) and £ = damping ratio. The meaning of the parameters w n and £ 
are explained in sections 3.6.4 and 3.6.3. 


3.6.2 Roots of the characteristic equation and their 

relationship to damping in second-order systems 

As discussed in Section 3.1, the transient response of a system is independent of the 
input. Thus for transient response analysis, the system input can be considered to be 
zero, and equation (3.41) can be written as 

(as 2 + bs + c)T'o(i’) = 0 

If 3f 0 (T) X O' then 


as 1 + bs + c = 0 


(3.44) 
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Table 3.4 Transient behaviour of a second-order system 


Discriminant 

Roots 

Transient response type 

b 1 > 4 ac 

and S2 real 

Overdamped 


and unequal 

Transient 


(-ve) 

Response 

b 1 = 4 ac 

and S2 real 

Critically 


and equal 

Damped Transient 


(-ve) 

Response 

b 2 < 4 ac 

and S2 complex 

Underdamped 


conjugate of the 

Transient 


form: si, S2= —a±juj 

Response 


This polynomial in s is called the Characteristic Equation and its roots will determine 
the system transient response. Their values are 


Si, s 2 = 


—b ± Vb 1 — 4 ac 
2 a 


(3.45) 


The term ( b 2 — 4 ac), called the discriminant, may be positive, zero or negative which 
will make the roots real and unequal, real and equal or complex. This gives rise to the 
three different types of transient response described in Table 3.4. 

The transient response of a second-order system is given by the general solution 

x a (t) = Ae s '‘ + Be S2 ‘ (3.46) 

This gives a step response function of the form shown in Figure 3.16. 



Fig. 3.16 Effect that roots of the characteristic equation have on the damping of a second-order system. 
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3.6.3 Critical damping and damping ratio 


Critical damping 

When the damping coefficient C of a second-order system has its critical value C c , the 
system, when disturbed, will reach its steady-state value in the minimum time without 
overshoot. As indicated in Table 3.4, this is when the roots of the Characteristic 
Equation have equal negative real roots. 

Damping ratio £ 

The ratio of the damping coefficient C in a second-order system compared with the 
value of the damping coefficient C c required for critical damping is called the 
Damping Ratio ( (Zeta). Hence 

C = Jr (3-47) 

Cc 

Thus 

£ = 0 No damping 
£ < 1 Underdamping 
( = 1 Critical damping 
( > 1 Overdamping 


Example 3.7 

Find the value of the critical damping coefficient C c in terms of K and m for the 
spring-mass-damper system shown in Figure 3.17. 



Lumped Parameter Diagram 
(a) 


Kx 0 Cx 0 


i 



m 


r 


F(t) 


x 0 V) 
* 0 (t) 


Free-Body Diagram 
(b) 


Fig. 3.17 Spring-mass-damper system. 
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Solution 

From Newton’s second law 

Fx = mx 0 

From the free-body diagram 

F(t) — Kx 0 (t) — Cx Q (t) = mx 0 (t) 
Taking Laplace transforms, zero initial conditions 

F(s) — KX 0 (s ) — CsX 0 (s) = ms 2 X 0 (s) 


Characteristic Equation is 


and the roots are 


(ms 2 + Cs + K)X 0 (s) = F(s) 


ms- + Cs + K = 0 


2 C K n 

i.e. s z H 1 — = 0 

m m 


4- 


For critical damping, the discriminant is zero, hence the roots become 


Also, for critical damping 


«i = S2 = - : 


Cl 4 K 


giving 


C c = 2\/~Km 


3.6.4 Generalized second-order system response to a unit step 
input 

Consider a second-order system whose steady-state gain is K, undamped natural 
frequency is u> n and whose damping ratio is (, where £ < 1. For a unit step input, the 
block diagram is as shown in Figure 3.18. From Figure 3.18 




s(s- + 2 (uj n s + u>l) 


(3.52) 
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x;(s)=i/s 



Fig. 3.18 Step response of a generalized second-order system for £ < 
Expanding equation (3.52) using partial fractions 


s (s 2 + 2(co n s + w 2 ) 
Equating (3.52) and (3.53) and multiply by s(s 2 + 2(to n s + w 2 ) 


Equating coefficients 


/fu .' 2 — A (.s ' 2 T 2Qjj n s ~h u .’ 2 ‘j -\ Bs~ -\~ Cs 

(s 2 ) : 0 = A + B 

C? 1 ): 0 = 2<w„,4 + C 

(/) : Kuj 2 n = ur n A 


giving 


A = K, B = —K and C = -2 C,u a K 
Substituting back into equation (3.53) 

r„(j) = Jc ri 1 s + 2< “" 

Completing the square 

X 0 (s) = K 


1 


s I .s 2 + 2 (w n s + w 2 
5 + 2C > u n 


S I ( s + (Wn) + — C w n 


= K 


s + 2£uj n 


(s + £w n )“ + (oJn \/ 1 ~ C 2 ) 


(3.53) 


(3.54) 


The terms in the brackets { } can be written in the standard forms 10 and 9 in 
Table 3.1. 


Term (1) = 


— s 


(s + (w n ) + {^n \/ 1 — C 2 ) 


Term (2) = — < 


2C^n 


^n V / ^C 5 


"" VT^C-j | ( ,2 + Cwn) 2 + ^ nX /T^2y 
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Inverse transform 

Xo(t) = K 


1 - | e CuV ^cos (w n \/l - C 2 ) t - ^ sin ( Wn \/ 1 - C 2 ) 

- { 7T=?} ( sin (“" v/r ^ ? ) ') } 


Equation (3.55) can be simplified to give 

1 - e“ Cw ' 


x 0 (t) = K 

When C = 0 


’"'|cos(w n \/l ~C 2 )t+ ( yp— shinny 7 ! - C 2 V 


(3.55) 


(3.56) 


x 0 (t) = K[\ - e°{cosu> n / + 0}] 
= K[\ - cosuV] 


(3.57) 


From equation (3.57) it can be seen that when there is no damping, a step input will 
cause the system to oscillate continuously at w n (rad/s). 

Damped natural frequency co d 

From equation (3.56), when 0 < C> 1, the frequency of transient oscillation is 
given by 

co d = co n Vl-C 2 (3.58) 

where is called the damped natural frequency. Flence equation (3.56) can be 
written as 


x 0 {t) = K 


= K 


1 — e { cos cud? + ( — , ^ 1 sincudt 

1 ITT?; 


1 - 


(^CO n t 


xA 3 ? 


:sin(wdt + <t>) 


where 


tan d> = 


vA 

C 


When £ = 1, the unit step response is 

x 0 (t) = K[ 1 - e- w "'(l + u D t)\ 

and when £ > 1, the unit step response from equation (3.46) is given by 


(3.59) 

(3.60) 

(3.61) 

(3.62) 


x 0 (0 = K 




1 


_i_ i I c— 

l 2 2 v^Tf 


(3.63) 
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“ n t{ rad) 


Fig. 3.19 Unit step response of a second-order system. 

The generalized second-order system response to a unit step input is shown in Figure 
3.19 for the condition K = 1 (see also Appendix 1, sec_ord.m). 


3.7 Step response analysis and performance 
specification 

3.7.1 Step response analysis 

It is possible to identify the mathematical model of an underdamped second-order 
system from its step response function. 

Consider a unity-gain (K = 1) second-order underdamped system responding to 
an input of the form 

x\(t) = B (3.64) 

The resulting output x 0 (t) would be as shown in Figure 3.20. There are two methods 
for calculating the damping ratio. 

Method (a): Percentage Overshoot of first peak 

%Overshoot = ^ x 100 (3.65) 

B 

Now 

a x = 
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B 


B 



Fig. 3.20 Step response analysis. 


Thus, 


B e -Cwn(r/2) 

%Overshoot = x 100 (3.66) 


Since the frequency of transient oscillation is tud, then, 

27T 

UJd 

2ir 

u n V 1 - C 2 

Substituting (3.67) into (3.66) 

% Overshoot = x 100 

% Overshoot = 


(3.67) 


(3.68) 


Method (b): Logarithmic decrement. Consider the ratio of successive peaks ci\ and a 2 

a\ = (3.69) 

a 2 = Se” f “” (3r/2) (3.70) 

Hence 

n, p-&n(r/2) 

_ _ e p {-C“n(-r/2)+Cw„(3r/2)} 

a2 e -C^„(3r/2) 

— e C“nT _ e 2Qr/y/l-(? 


( 3 . 71 ) 


Time domain analysis 57 


Equation (3.71) can only be used if the damping is light and there is more than one 
overshoot. Equation (3.67) can now be employed to calculate the undamped natural 
frequency 


W n 


2n 

T\Z l ~ C 2 


(3.72) 


3.7.2 Step response performance specification 

The three parameters shown in Figure 3.21 are used to specify performance in the 

time domain. 

(a) Rise time t T : The shortest time to achieve the final or steady-state value, for the 
first time. This can be 100% rise time as shown, or the time taken for example 
from 10% to 90% of the final value, thus allowing for non-overshoot response. 

(b) Overshoot : The relationship between the percentage overshoot and damping 
ratio is given in equation (3.68). For a control system an overshoot of between 
0 and 10% (1 < ( > 0.6) is generally acceptable. 

(c) Settling time t s : This is the time for the system output to settle down to within a 
tolerance band of the final value, normally between ±2 or 5%. 

Using 2% value, from Figure 3.21 

0.025 = 

Invert 

50 = e c “"' s 



Fig. 3.21 Step response performance specification. 
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Take natural logs 


giving 


In 50 = (ui n t s 



(3.73) 


The term (l/£w n ) is sometimes called the equivalent time constant T c for a second- 
order system. Note that In 50 (2% tolerance) is 3.9, and In 20 (5% tolerance) is 3.0. 
Thus the transient period for both first and second-order systems is three times the 
time constant to within a 5% tolerance band, or four times the time constant to 
within a 2% tolerance band, a useful rule-of-thumb. 


3.8 Response of higher-order systems 

Transfer function techniques can be used to calculate the time response of higher- 
order systems. 

Example 3.8 (See also Appendix 1, examp38.m) 

Figure 3.22 shows, in block diagram form, the transfer functions for a resistance 
thermometer and a valve connected together. The input x,(t) is temperature and the 
output x Q {t ) is valve position. Find an expression for the unit step response function 
when there are zero initial conditions. 

Solution 

From Figure 3.22 


Y (-) - 25 

oV> s(l + 2s)(s 2 + s + 25) 

(3.74) 

12.5 

s(s + 0.5)(.s 2 + s + 25) 

(3.75) 

A B Cs + D 

~ S + (s + 0.5) (.s' + 0.5) 2 + (4.97) 2 

(3.76) 


Resistance Thermometer 


Valve 


=1/s 

1 

1 + 2s 


25 




s 2 + s + 25 



_ >A(s) 


Fig. 3.22 Block diagram representation of a resistance thermometer and valve. 
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Note that the second-order term in equation (3.76) has had the ‘square’ completed 
since its roots are complex ( b 2 < 4 ac). Equate equations (3.75) and (3.76) and multi- 
ply both sides by s(s + 0.5)(s 2 + s + 25). 

12.5 = (s 3 + 1.5^ 2 + 25.5s + 12.5)A + (s 3 + s 2 + 25s)B 

(3 77) 

+ (s 3 + 0.5s 2 )C + (s 2 + 0.5 s)D 

Equating coefficients 

(s 3 ) : 0 = A + B + C 

(s 2 ) : 0= 1.5+ + 5 + 0.5C + 7) 

(s 1 ): 0 = 25.5+ + 255 + 0.57) 

(s°) : 12.5 = 12.5+ 


Solving the four simultaneous equations 

A = l, 5 = -1.01, C = 0.01, D = —0.5 


Substituting back into equation (3.76) gives 

_ 1 1.01 0.0b -0.5 

~ ~s ~ (s + 0.5) + ( S + 0.5) 2 + (4.97) 2 

Inverse transform 

x Q (t)= 1 - 1.01e~°' 5r — 0.01e~°' 5 '(10.16sin4.97t — cos4.97t) 


(3.78) 

(3.79) 


Equation (3.79) shows that the third-order transient response contains both first- 
order and second-order elements whose time constants and equivalent time constants 
are 2 seconds, i.e. a transient period of about 8 seconds. The second-order element 
has a predominate negative sine term, and a damped natural frequency of 4.97 rad/s. 
The time response is shown in Figure 3.23. 



Fig. 3.23 Time response of third-order system. 
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3.9 Further problems 


Example 3.9 

A ship has a mass m and a resistance C times the forward velocity u(t). If the thrust 
from the propeller is K times its angular velocity u>(t), determine: 

(a) The first-order differential equation and hence the transfer function relating U ( 5 ) 
and ut(s). 

When the vessel has the parameters: m = 18 000 x 10 3 kg, C = 150 000 Ns/m, and 
K = 96 000 Ns/rad, find, 

(b) the time constant. 

(c) an expression for the time response of the ship when there is a step change of ui(t) 
from 0 to 12.5 rad/s. Assume that the vessel is initially at rest. 

(d) What is the forward velocity after 

(i) one minute 

(ii) ten minutes. 


Solution 


(a) m(du/dt) + Cu = Kuj(t) 


U 

U) 


CO 


K/C 

1 + ( m/C)s 


(b) 120 seconds 

(c) u{t) = 8(1 - e- 000833 ') 

(d) (i) 3. 148 m/s 
(ii) 7.946 m/s 


Example 3.10 

(a) Determine the transfer function relating (A (a) and V\ (s) for the passive electrical 
network shown in Figure 3.24. 

(b) When C = 2pF and = R 2 — l Mfl, determine the steady-state gain K and 
time constant T. 

(c) Find an expression for the unit step response. 



v 2 (t) 


Fig. 3.24 Passive electrical network. 
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Solution 


V 2 Ri/ R\ + i?2 


V\ v ' l + (R i R 2 C/Ri+R 2 )s 


(b) 0.5 

1.0 seconds 


(c) v o (0 = 0.5(1 - e-0 


Example 3.11 

Determine the values of oj n and ( and also expressions for the unit step response for 
the systems represented by the following second-order transfer functions 



Solution 


(i) 2.0 

1 .0 (Critical damping) 
x 0 {t) = 1 - e~ 2 '(l + 2 1 ) 

(ii) 2.236 

1.342 (Overdamped) 
x 0 (t) = 2 — 2.5e~‘ + 0.5e~ 5 ' 

(iii) 1.0 

0.5 (Underdamped) 

x 0 (t) = 1 - e _0 - 5 '( cos 0.866? + 0.577 sin 0.866t) 

Example 3.12 

A torsional spring of stiffness K, a mass of moment of inertia / and a fluid damper 
with damping coefficient C are connected together as shown in Figure 3.25. The 
angular displacement of the free end of the spring is 9[(t) and the angular displace- 
ment of the mass and damper is 9 0 (t). 


n 



K 



Fig. 3.25 Torsional system. 


/ 


u 

c 
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(a) Develop the transfer function relating 6i(s) and d 0 (T). 

(b) If the time relationship for dj(?) is given by dj(?) = 4? then find an expression for 
the time response of 9 0 (t). Assume zero initial conditions. What is the steady- 
state error between dj(?) and d 0 (?)? 

Solution 

(a) ! w= (*y+ffl*+i 

(b) 0 o (t) = At — 0.2 + e~ 2 - 5 '(0.2 cos 9.682? - 0.361 sin 9.682?) 

0.2 radians. 

Example 3.13 

When a unity gain second-order system is subject to a unit step input, its transient 
response contains a first overshoot of 77%, occurring after 32.5 ms has elapsed. Find 

(a) the damped natural frequency 

(b) the damping ratio 

(c) the undamped natural frequency 

(d) the system transfer function 

(e) the time to settle down to within ±2% of the final value 

Solution 

(a) 96.66 rad/s 

(b) 0.083 

(c) 96.99 rad/s 


w w 0.106 x 10-V+ 1.712 x 10-%+ 1 
(e) 0.486 seconds 


Example 3.14 

A system consists of a first-order element linked to a second-order element without 
interaction. The first-order element has a time constant of 5 seconds and a steady- 
state gain constant of 0.2. The second-order element has an undamped natural 
frequency of 4 rad/s, a damping ratio of 0.25 and a steady-state gain constant of 
unity. 

If a step input function of 10 units is applied to the system, find an expression for 
the time response. Assume zero initial conditions. 

Solution 

Xo (?) = 2.0 - 2.046e~ 0,2 ' + e~ r (o.046 cos v^? - 0.094 sin \/l5?) 



4 


Closed-loop control 
systems 


4.1 Closed-loop transfer function 

Any system in which the output quantity is monitored and compared with the input, 
any difference being used to actuate the system until the output equals the input is 
called a closed-loop or feedback control system. 

The elements of a closed-loop control system are represented in block diagram 
form using the transfer function approach. The general form of such a system is 
shown in Figure 4.1. 

The transfer function relating R(s) and CO) is termed the closed-loop transfer 
function. 

From Figure 4.1 


CO) = G(s)E(s) 

(4.1) 

B(s ) = //(.v)C(v) 

(4.2) 

E(s) = R(s) - Bis) 

(4.3) 

Substituting (4.2) and (4.3) into (4.1) 


CO) = G(s){ R(s) - H(s)C(s)} 

CO) = G(s)R(s) - G(s)H(s)C(s) 

C0){1 + G(s)H(s)} = G(s)R(s) 


S)= G(5) 

R ’ \ + G(s)H(s) 

(4.4) 


The closed-loop transfer function is the forward-path transfer function divided by 
one plus the open-loop transfer function. 
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Forward Path 

► 


Summing 



Fig. 4.1 Block diagram of a closed-loop control system. R(s) = Laplace transform of reference input r(f); 
C(s) = Laplace transform of controlled output c(f); B(s) = Primary feedback signal, of value H(s)C(s); 
E(s) = Actuating or error signal, of value R(s) — B(s)', G(s) = Product of all transfer functions along the 
forward path; H(s) = Product of all transfer functions along the feedback path; G(s)H(s) = Open-loop 
transfer function; (g) = summing point symbol, used to denote algebraic summation; • = Signal take-off 
point; — » = Direction of information flow. 


4.2 Block diagram reduction 
4.2.1 Control systems with multiple loops 

A control system may have several feedback control loops. For example, with a ship 
autopilot, the rudder-angle control loop is termed the minor loop, whereas the 
heading control loop is referred to as the major loop. When analysing multiple loop 
systems, the minor loops are considered first, until the system is reduced to a single 
overall closed-loop transfer function. 

To reduce complexity, in the following examples the function of s notation (s) used 
for transfer functions is only included in the final solution. 

Example 4.1 

Find the closed-loop transfer function for the system shown in Figure 4.2. 

Solution 

In Figure 4.2, the first minor loop to be considered is G 1 H 3 . Using equation (4.4), this 
may be replaced by 


G m \ 


G 3 


1 + G3//3 


(4.5) 
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First Minor Loop 



Fig. 4.2 Multiple loop control system. 


Now G m i is multiplied by, or in cascade with Gt. Hence the combined transfer 
function is 




G2G3 
I +G 3//3 


(4.6) 


The reduced block diagram is shown in Figure 4.3. 

Following a similar process, the second minor loop G m 2 may be written 


Cm2 


G 2 G 3 

1 + G3#3 
1 _i_ G2G3H2 
1 I+G3//3 


Multiplying numerator and denominator by 1 + G 3//3 


G m 2 


G 2 G 3 

1 + G 3//3 + G 2 G;JI 2 


But G m 2 is in cascade with Gi, hence 


G\Gm2 


G 1 G 2 G 3 

1 + G 3//3 3 G 2 G 3//2 


(4.7) 


Transfer function (4.7) now becomes the complete forward-path transfer function as 
shown in Figure 4.4. 
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Second Minor Loop 



Fig. 4.3 First stage of block diagram reduction. 



The complete, or overall closed-loop transfer function can now be evaluated 

„ 0 | ( ( i 

W \ = _ l +G 3 H 3 +G 7 G 3 H 7 
R 1 ' 1 , G|G 2 G 3 JT| 

1 i+G,/y,+G-.G,7r, 


Multiplying numerator and denominator by 1 + G 3 H 3 + G2G3H2 


C Gi(s)G 2 (.s)G 3 (s) 

R 1 + G 3 (s)H 3 (s) + G 2 (s)G 3 (s)H 2 (s) + G\(s)G 2 (s)G 3 {s)H ( (s) 


( 4 . 8 ) 
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4.2.2 Block diagram manipulation 

There are occasions when there is interaction between the control loops and, for the 
purpose of analysis, it becomes necessary to re-arrange the block diagram configur- 
ation. This can be undertaken using Block Diagram Transformation Theorems. 

Table 4.1 Block Diagram Transformation Theorems 
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Example 4.2 

Moving a summing point ahead of a block. 

Equation Equation 

Z = GX±Y Z={X±(l/G)Y}G (4.9) 

Z=GX±Y 

A complete set of Block Diagram Transformation Theorems is given in Table 4.1. 


Example 4.3 

Find the overall closed-loop transfer function for the system shown in Figure 4.6. 
Solution 

Moving the first summing point ahead of G\ , and the final take-off point beyond G 4 
gives the modified block diagram shown in Figure 4.7. The block diagram shown in 
Figure 4.7 is then reduced to the form given in Figure 4.8. The overall closed-loop 
transfer function is then 


C 

R 


(s) 


G 1 G2G3G4 

(1+GiG 2 #i)(1+G 3 G4#2) 

1 1 01 (72(7304 #3 

1 {0 l 0 A ){\+G x G 2 H l ){\+G^G A H 2 ) 

Gl(s)G2(s)G3(s)G4(.v) 

(1 + G i (5)G 2 (j)//,( 5))(1 + G 3 (s)G 4 (s)ff 2 (s)) + G 2 (s)G 3 (s)J/ 3 (s) 


(4.10) 



Fig. 4.5 Moving a summing point ahead of a block. 



Fig. 4.6 Block diagram with interaction. 
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Fig. 4.7 Modified block diagram with no interaction. 



Fig. 4.8 Reduced block diagram. 


4.3 Systems with multiple inputs 
4.3.1 Principle of superposition 

A dynamic system is linear if the Principle of Superposition can be applied. This 
states that ‘The response y(t ) of a linear system due to several inputs x\{f), 
x 2 (t ), . . . , x„(t), acting simultaneously is equal to the sum of the responses of each 
input acting alone’. 


Example 4.4 

Find the complete output for the system shown in Figure 4.9 when both inputs act 
simultaneously. 

Solution 

The block diagram shown in Figure 4.9 can be reduced and simplified to the form 
given in Figure 4.10. Putting AN(.v) = 0 and replacing the summing point by +1 gives 
the block diagram shown in Figure 4.11. In Figure 4.1 1 note that C 1 (s) is response to 
R\{s) acting alone. The closed-loop transfer function is therefore 


C 1 

R\ 


(s) 


G\G 2 

\+g 2 h 2 

i G\G 2 H\ 

1 ^ 1 +g 2 h 2 
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or 


CV) 


G\(s)G 2 (s)Ri(s) 

1 + G 2 (s)H 2 (s ) + G ] (s)G 2 (.s)H i (s) 


(4.11) 


Now if /?i (,y) = 0 and the summing point is replaced by —1, then the response C n (.s) 
to input R 2 (s) acting alone is given by Figure 4.12. The choice as to whether 
the summing point is replaced by +1 or —1 depends upon the sign at the summing 
point. 

Note that in Figure 4.12 there is a positive feedback loop. FLence the closed-loop 
transfer function relating R 2 (s) and C n (.sj is 

WI —GiGiH\ 

— (s) = x+GlHl 

R 2 i ( -G\G2H\ \ 

V i +g 2 h 2 ) 


fll (S) + 




Fig. 4.9 System with multiple inputs. 



Fig. 4.10 Reduced and simplified block diagram. 
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Fig. 4.11 Block diagram for /?i(s) acting alone. 



Fig. 4.12 Block diagram for R 2 (s) acting alone. 


or 


r n f = 

y> 1 + G 2 (s)H 2 (s) + G x {s)G 2 {s)H { (s) K ■ 

It should be noticed that the denominators for equations (4.11) and (4.12) are 
identical. Using the Principle of Superposition, the complete response is given by 

C(,v) = C'(s) + C"(j) (4.13) 


or 


C(s) 


(G l (s)G 2 (s))R l (s) - (Gi(j)Ch(j)gi(s))* 2 (s) 
1 + G 2 (s)H 2 (s) + G\(s)G 2 {s)H\ ( 5 ) 


(4.14) 


4.4 Transfer functions for system elements 
4.4.1 DC servo-motors 

One of the most common devices for actuating a control system is the DC servo- 
motor shown in Figure 4.13, and can operate under either armature or field control. 

(a) Armature control : This arrangement is shown in schematic form in Figure 4. 14. 
Now air gap flux 4> is proportional to if, or 


<b = Kak 


(4.15) 
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Fig. 4.13 Simple DC servo-motor, 
where Kf^ is the field coil constant. 

Also, torque developed T m is proportional to the product of the air gap flux and 
the armature current 


T m (t) = <bK dm i d (t) 


( 4 . 16 ) 
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Fig. 4.14 DC servo-motor under armature control. e a (t) = Armature excitation voltage; eb(f) = Backemf; 
/ a (f) = Armature current; R a = Armature resistance; L a = Armature inductance; e f = Constant field 
voltage; 4 = Constant field current; T m = Torque developed by motor; 9(t) = Shaft angular displacement; 
ui(t) = Shaft angular velocity = d(9/dt. 


where K am is the armature coil constant. 

Substituting (4.15) into (4.16) gives 

T m (t) = (K a K am i[)i a (t) (4.17) 

Since if is constant 

T m (t) = K.J.Jt) (4.18) 

where the overall armature constant K a is 

K a = K M K am i { (4.19) 

When the armature rotates, it behaves like a generator, producing a back emf eb(0 
proportional to the shaft angular velocity 

e b (t) = K b ^ = K h co(t) (4.20) 

where K h is the back emf constant. 

The potential difference across the armature winding is therefore 

e a (t)-e b (t) = L a ^+R a i a (4.21) 

Taking Laplace transforms of equation (4.21) with zero initial conditions 

E a (s) - E b (s) = (L a s + R a )LJs) (4.22) 

Figure 4.15 combines equations (4.18), (4.20) and (4.22) in block diagram form. 
Under steady-state conditions, the torque developed by the DC servo-motor is 


T m (t) = {e a (t)-K b u>(t)}§ 
Tv 
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or 


T m (t) = 00 e,{t) - 0^) w(t) (4.23) 

From equation (4.23), the relationship between T m (t), u>(t) and E d (t) under steady- 
state conditions is shown in Figure 4.16. 

(b) Field control'. This arrangement is shown in schematic form in Figure 4.13, 
with the exception that the armature current i d is held at a constant value. Equation 
(4. 1 7) may now be written as 


7m (0 = (K (A K dm i d )k(t) (4.24) 

and since i d is a constant, then 

7m(0 = K f Ht) (4-25) 

where the overall field constant K[ is 

K( = K a K am i d (4.26) 

In this instance, the back emf e\> does not play a part in the torque equation, but it 
can produce difficulties in maintaining a constant armature current i d . 

The potential difference across the field coil is 

e f (t)= L f ^-+ R f i f ( 4.27 ) 

dr 

Taking Laplace transforms of equation (4.27) with zero initial conditions 

Eds) = (U, + Rt)h(s) (4.28) 


Figure 4.17 combines equations (4.25) and (4.28) in block diagram form. 
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Fig. 4.16 Steady-state relationship between T m (t), ui(t) and e a (f) for an armature controlled DC servo- 
motor. 



Fig. 4.17 Block diagram representation of field controlled DC servo-motor. 


Under steady-state conditions, the torque developed by the DC servo-motor is 

Tm(t) = (fO ef( ° (4 ' 29) 

The relationship between T m (t), Cf (?) and u(t) under steady-state conditions is shown 
in Figure 4.18. 


4.4.2 Linear hydraulic actuators 

FLydraulic actuators are employed in such areas as the aerospace industry because 
they possess a good power to weight ratio and have a fast response. 

Figure 4.19 shows a spool-valve controlled linear actuator. When the spool-valve 
is moved to the right, pressurized hydraulic oil flows into chamber (1) causing the 
piston to move to the left, and in so doing forces oil in chamber (2) to be expelled to 
the exhaust port. 

The following analysis will be linearized for small perturbations of the spool-valve 
and actuator. 
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T m (t) 

(Nm) 


Increc 

i 

asing e,(f) 

i 







ui( t) (rad/s) 

(b) 


Fig. 4.18 Steady-state relationship between T m (t), 0f(t) and u(t) for a field controlled DC servo-motor. 


Pe= 0 P s P e— 0 



Qleak 


Fig. 4.19 Spool-valve controlled linear actuator. 


It is assumed that: 

• the supply pressure P s is constant 

• the exhaust pressure P e is atmospheric 

• the actuator is in mid-position so that V\ = V 2 = V Q which is half the total volume 
of hydraulic fluid V t 

• the hydraulic oil is compressible 

• the piston faces have equal areas A 

• Q\ and Q 2 are the volumetric flow-rates into chamber (1) and out of chamber (2) 

• the average, or load flow-rate Ql has a value (Q \ + 

• P\ and P 2 are the fluid pressures in chamber (1) and chamber (2) 

• the load pressure P l has a value (Pi — P 2 ) 
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(a) Actuator analysis'. The continuity equation for the chambers may be written 

Y j Qi n — ^ 2out = (rate of change of chamber volume) 

+ (rate of change of oil volume) (4.30) 


In equation (4.30), the rate of change of chamber volume is due to the piston 
movement, i.e. dV/d t. The rate of change of oil volume is due to compressibility 
effects, i.e.: 

Bulk Modulus of oil, (3 = Volumetric stress/Volumetric strain 


P 


d P 

-dV/V 


(4.31) 


Note that in equation (4.31) the denominator is negative since an increase in pressure 
causes a reduction in oil volume. 

Hence 


dV _ d P 

Giving, when differentiated with respect to time 


dV 

dr 


F\ dP 
(3Jdt 


(4.32) 


For chamber ( 1 ), equation (4.30) may be expressed as 


Q\ - Gleak = — 


and for chamber (2) 


Now 


Gleak — 0.2 = 


VA d/h 

PJ dr 


dF 2 /V 2 \ dP 2 
dT + ) ~di 


(4.33) 


(4.34) 


Ql = 


Qi + Qi 


Thus, from eqations (4.33) and (4.34) 

If leakage flow-rate Gleak is laminar, then 


- V 2 


d P : 
dr 


(4.35) 


Gleak — C p P L 


(4.36) 
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where C p is the leakage coefficient. Also, if V\ = V 2 = V 0 , then 

dV 2 _ dVi _ dV Q 
dr dr dr 


Hence equation (4.35) can be written 


Q L 


CvPl + 


dV 0 
d t 


2(3 dr 1 


Pi) 


or 


Gl 


C p P l + A 


dAo 

dr 


V t dP L 
4 (3 dr 


where 


dV ° _ A dX ° 

dr dr 


(4.37) 


(4.38) 


(4.39) 


and 


V 0 = 


Vt 

2 


(b) Linearized spool-valve analysis : Assume that the spool-valve ports are rectan- 
gular in form, and have area 

A v = WX V (4.40) 

where W is the width of the port. 

From orifice theory 


Gi 


C d WX v J-(P s - PO 


(4.41) 


and 


G2 


C<| WXy 



(Pi - 0) 


whereo Cd is a coefficient of discharge and p is the fluid density. 
Equating (4.41) and (4.42) 


(4.42) 


Ps-P 1 = Pi 


(4.43) 


since 


Pl = Pi~ Pi 


Equation (4.43) may be re-arranged to give 


Pi = 


P s + Pl 


2 


(4.44) 
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From equations (4.41) and (4.42) the load flow-rate may be written as 


Ql = C d fFF v y^ ^ 2 j (4.45) 

Hence 


Ql = F(X v ,P h ) 


(4.46) 


Equation (4.45) can be linearized using the technique described in section 2.7.1. If q^, 
x v and pl are small perturbations of parameters Q l, Xy and Pl about some operat- 
ing point ‘a’, then from equation (4.46) 


</L 


OQl 

dX v 


+ 

a 


dQ L 

dP L 


P l 

a 


(4.47) 


or 


</L = ^qX v - A' c /9| 


(4.48) 


where 


K q (flow gain) 


C d W 



(Ps ~ ^La) 


(4.49) 


and 

(flow-pressure coefficient which has a negative value) 

-~c d wx va i r 

C 2 V p(P s - P La ) 


(4.50) 


Note that Pl 3 and X va are the values of Pl and X v at the operating point ‘a’. 

The relationship between Q l, Pl and X v , from equation (4.45), together with the 
linearized relations q L , Pl and ,v v are shown in Figure 4.20. 

Equation (4.39) is true for both large and small perturbations, and so can be 
written 


. _ A d*o , n , V,d;; L 
CJL ~ A ~dt~ + CpPh + 4/3~dt~ 


Equating (4.48) and (4.51) gives 


(4.51) 


KqXy 


= A d? ° + (Cp + K c )p L + 


Ft dp L 
4/3 d t 


(4.52) 


Taking Laplace transforms (zero initial conditions), but retaining the lower-case 
small perturbation notation gives 


K q -V v (.s) 


F t 

Asx 0 (s) + (Cp + K c ) + —s 


Pl(s) 


(4.53) 
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Fig. 4.20 Pressure-Flow-rate characteristics fora spool-valve. 


The force to accelerate the mass m is shown in Figure 4.21. From Figure 4.21 

^ F x = mx 0 
AP^ = mx 0 


(4.54) 


Take Laplace transforms with zero initial conditions and using lower-case notation 


rn 2 

Pl(s) = —rx 0 (s) 


Inserting equation (4.55) into (4.53) gives 

= TsWoLO + |(C P + K c ) + ^.s'j (^s 2 ^x 0 (s) 


(4.55) 


(4.56) 


Equation (4.56) may be re-arranged to give the transfer function relating .\ 0 (.v) and 
Xy(s) 


A P L 


A 

m 


Xo (f), Xo (f), x 0 (f) 


Fig. 4.21 Free-body diagram of load on hydraulic actuator. 
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* w = a 

* v *{(s&> 2 +( s s s >+i} 


Equation (4.57) can be written in the standard form 

K h 


0 / \ 

— ( s ) — ~r . \ 

Xv + — l ) 

V4 “” h / 


where 


K h (hydraulic gain) 
oj n h (hydraulic natural frequency) 

Ch (hydraulic damping ratio) 



f C P + K c \ I 4/3 
V 2 ) y mViA 2 


(4.57) 


(4.58) 


Since the Bulk Modulus of hydraulic oil is in the order of 1 .4 GPa, if m and V t are 
small, a large hydraulic natural frequency is possible, resulting in a rapid response. 
Note that the hydraulic damping ratio is governed by Cp and K l: . T o control the level 
of damping, it is sometimes necessary to drill small holes through the piston. 


4.5 Controllers for closed-loop systems 
4.5.1 The generalized control problem 

A generalized closed-loop control system is shown in Figure 4.22. The control 
problem can be stated as: ‘The control action u(t) will be such that the controlled 
output c{t ) will be equal to the reference input r\(t) for all values of time, irrespective 
of the value of the disturbance input r 2 ( 0 ’- 

In practice, there will always be transient errors, but the transient period should be 
kept as small as possible. It is usually possible to design the controller so that steady- 
state errors are minimized, or ideally, eliminated. 



Fig. 4.22 Generalized closed-loop control system. 
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4.5.2 Proportional control 

In this case, the control action, or signal is proportional to the error e{t) 

u(t) = K\e{t) (4.59) 

where K\ is the proportional gain constant. 

If the plant dynamics are first-order, then Figure 4.22 can be described as shown in 
Figure 4.23. The plant transfer function is 

(U(s) - R 2 (s)) = C(s) (4.60) 

And the proportional control law, from equation (4.59) becomes 

U(s) = KUR^s) - C(s)) (4.61) 


Inserting equation (4.61) into equation (4.60) gives 

(1 + Ts) 

which can be written as 


C(s) = 


(4.62) 


{(1 +K t K) + Ts}C(s ) = K t KR { (s) - KR 2 (s ) 
Re-arranging equation (4.63) gives 


C(s) = 


I 1 + (i+J,/c) • s ’} 


(4.63) 


(4.64) 


When r\(t) is a unit step, and r 2 (t) is zero, the final value theorem (equation (3.10)) 
gives the steady-state response 


c(0 = 


K\K 
1 + KiK 


as t — > oo. 


R 2 (s) 


Proportional 

Controller 


Hi(s) +. 



Fig. 4.23 Proportional control of a first-order plant. 
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When r 2 (?) is a unit step, and r\{t) is zero, the final value theorem (equation (3.10)) 
gives the steady-state response 

c(0= -(rrb) as '^°°- 

Hence, for the system to have zero steady-state error, the terms in equation (4.64) 
should be 


KiK \ 
1 +K l KJ 

\1 + K\KJ 


= 1 

= 0 


(4.65) 


This can only happen if the open-loop gain constant K\K is infinite. In practice this is 
not possible and therefore the proportional control system proposed in Figure 4.23 
will always produce steady-state errors. These can be minimized by keeping the open- 
loop gain constant K\K as high as possible. 

Since the closed-loop time-constant form equation (4.64) is 

<466) 

Then maintaining K\ K at a high value will reduce the closed-loop time constant and 
therefore improve the system transient response. 

This is illustrated in Figure 4.24 which shows a step change in r\ (t) followed by a 
step change in /-?(/). 


Summary 

For a first-order plant, proportional control will always produce steady-state errors. 
This is discussed in more detail in Chapter 6 under ‘system type classification’ where 
equations (6.63)— (6.65) define a set of error coefficients. Increasing the open-loop 



Fig. 4.24 Step response of a first-order plant using proportional control. 
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gain constant (which is usually achieved by increasing the controller gain K\) will 
reduce, but not eliminate them. A high controller gain will also reduce the transient 
period. However, as will be shown in Chapters 5 and 6, high open-loop gain 
constants can result in the instability of higher-order plant transfer functions. 


4.5.3 Proportional plus Integral (PI) control 


Including a term that is a function of the integral of the error can, with the type of 
plant shown in Figure 4.23, eliminate steady-state errors. 

Consider a control law of the form 


u(t) = K\e{t) + K 2 


edt 


Taking Laplace transforms 


U(s) 



(4.67) 


= A '( l+ i|) £(s) 

= 7, ( I + ^ J E(s) (4.68) 

In equation (4.68), 7) is called the integral action time, and is formally defined as: 
‘The time interval in which the part of the control signal due to integral action 
increases by an amount equal to the part of the control signal due to proportional 
action when the error is unchanging’. (BS 1523). 

Inserting the PI control law given in equation (4.68) into the first-order plant 
transfer function shown in equation (4.60) gives 


C(s) 


(Ki( 1 + 1 /TisXRiis) - C(s)) - R 2 (s))K 

(1 + 7, s) 


(4.69) 


which can be written as 


{7,7s 2 + 7;(1 + 7, K) s + KiK}C(s) = 7j7( 1 + T,s)R t (s) - 7, KT t sR 2 (s) (4.70) 
Re-arranging gives 


C{s) 


(1 + Tjs)Ri(s) — T,sR2(s) 

(Hi) 5,2 + T ' ( ! + zjx) s + 1 


(4.71) 


The denominator is now in the standard second-order system form of equation 
(3.42). The steady-state response may be obtained using the final value theorem 
given in equation (3.10). 


c(t ) = (1 + O)rj(t) — (0)r2(t) as t — > 00 


(4.72) 
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Fig. 4.25 Step response of a first-order plant using PI control. 

When there are step changes in r\(t) and rjit): 

C(,) = ( ' +0W|,| - ( ||*M 
£ £ 

= R\(s) 

c{i) = n{f) (4.73) 

Thus, when r\{t) and ri(l) are unchanging, or have step changes, there are no steady- 
state errors as can be seen in Figure 4.25. The second-order dynamics of the closed- 
loop system depend upon the values of 7), T , K\ and K. Again, a high value of K\ will 
provide a fast transient response since it increases the undamped natural frequency, 
but with higher order plant transfer functions can give rise to instability. 

Summary 

For a first-order plant, PI control will produce a second-order response. There will be 
zero steady-state errors if the reference and disturbance inputs r\(t) and r^it) are 
either unchanging or have step changes. The process of including an integrator within 
the control loop to reduce or eliminate steady-state errors is discussed in more detail 
in Chapter 6 under ‘system type classification’. 

Example 4.5 (See also Appendix 1, examp45.m) 

A liquid-level process control system is shown in Figure 4.26. The system parameters 
are 

A = 2 m 2 Rf = 1 5 s/m 2 

H\ = 1 V/m K v = 0.1 ni 3 /sV K\ = 1 (controller again) 

(a) What are the values of T\ and ( when the undamped natural frequency oj n is 
0.1 rad/s? 

(b) Find an expression for the time response of the system when there is a step 
change of h&(t) from 0 to 4 m. Assume zero initial conditions. 
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Fig. 4.26 Liquid-level process control system. 


The controller is given in equation (4.68). The inflow to the tank is 

vi (t) = K v u(t) (4.74) 

The tank dynamics are expressed, using equation (2.63) as 

vi(t) - v 2 (t) = (4-75) 

and the linearized outflow is 


v 2 (0 = 


Kit) 

Rf 


(4.76) 


The measured head h m (t) is obtained from the pressure transducer 

h m (t) = HiKit) (4.77) 

From equations (4.75) and (4.76), the tank and outflow valve transfer function is 

R[ 


Vi W 1 + AR f s 


(4.78) 


The block diagram for the control system is shown in Figure 4.27. From the block 
diagram, the forward-path transfer function G(s) is 


G(s) = 


KiK v 


(1 + AR[S) 
K { K,Rf(\ + Tis) 


(4.79) 


Ti.y(l + AR r ) 
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PI Controller Tank and valve 



Fig. 4.27 Block diagram for liquid-level process control system. 

Using equation (4.4), the closed-loop transfer function becomes 


KiKyR^l+TiS) 

(AR[TiS 2 +Tis) 


H * } 


(4.80) 


which simplifies to 


KiK.Rfil + Tis) 


a±, s)= 

H d v (AR f TOs 2 + 7,(1 + K\ K v RfHi )s + K x K,R ( H\ 


(4.81) 


Equation (4.81) can be expressed in the standard form of equation (3.42) for a 
second-order system. 

Putting H\ = 1, then 


H* f . 


(1 + T iS ) 


(a,A v ) ^ (a, A' v Af + l) S + ^ 


(4.82) 


(a) Comparing the denominator terms with the standard form given in equation (3.42) 


AT i 
K\ K v 

1 


1 




From equation (4.83) 


Ti = 


KiK v R { 

K X K V 1x0.1 


+ 1 = 


2C 


ujIA 0.1 2 x 2 


Wn 


= 5 seconds 


(4.83) 

(4.84) 


From equation (4.84) 


c = 


uj n T { / 1 

2 \K\K W R[ 


+ 1 


0.1 x 5 


1 


1 x 0.1 x 15 


+ 1 = 0.417 
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(b) Inserting values into equation (4.82) 

H U,)~ 0+5s) 

H d ’ lOO.v 2 + 8.34.9 + 1 


(4.85) 


For a step input of height 4 m 


4 

5 

Expanding by partial fractions using 3.2.4 (iv) 


H a (s) = 


0.01(1 + 55) 


0.0834.V + 0.01 


HJs) 


0.04 + 0.25 
5(5 2 + 0.0834.9 + 0.01) 


A Bs+C 

7 + 5 2 + 0.08345 + 0.01 


Multiplying through by s(s 2 + 0.08345 + 0.01) 


0.04 + 0.25 = A(s 2 + 0.08345 + 0.01) + Bs 2 + Cs 


(4.86) 


Equating coefficients 


giving 


( 5 2 ) : 0 = A + B 

( 5 1 ): 0.2 = 0.0834+ + C 

( 5 °) : 0.04 = 0.01+ 

A = 4 B = - 4 C = -0.1336 


Substituting values back into (4.86) and complete the square to give 


rr/x 4 -45- 0.1336 

H a (s) — — I ^ 

5 (5 + 0.041 7) 2 


0.0909 2 

Inverse transform using Laplace transform pairs (9) and (10) in Table 3.1. 


(4.87) 


H a (s) = -~ 


45 


5 ((5 + 0.0417) 2 + 0.0909 2 


- 1.4697 


0.0909 


1(5 + 0.041 7) 2 + 0.0909 2 


h a (t) = 4 - 4e-°' 0417 ' ^cos0.0909t - sin 0.0909^ 


- 1.4697e-° 0417r sin 0.0909? 


which simplifies to give 

hjt) = 4[1 - e-°'° 417 '(cos0.0909t- 0.0913 sin 0.09090] (4.88) 
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Fig. 4.28 Response of the PI controlled liquid-level system shown in Figure 4.26 to a step change in /ld(f) 
from 0 to 4 m. 


In equation (4.88) the amplitude of the sine term is small, compared with the cosine 
term, and can be ignored. Hence 

/z a (0 = 4(1 - e" 00417 ' cos 0.0909?) (4.89) 

The time response depicted by equation (4.89) is shown in Figure 4.28. 


4.5.4 Proportional plus Integral plus Derivative (PID) control 

Most commercial controllers provide full PID (also called three-term) control action. 
Including a term that is a function of the derivative of the error can, with high-order 
plants, provide a stable control solution. 

Proportional plus Integral plus Derivative control action is expressed as 


f de 

u(t) = K\e(t) + K 2 edt + Kj, — 


(4.90) 


Taking Laplace transforms 


U(s) = ( K\ + — + K^s ) E(s) 

= Kl[l+ §s + f l s]m 

= K l ( 1 + ^ + T a s ) E(s) 


(4.91) 
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In equation (4.91), T d is called the derivative action time, and is formally defined as: 
‘The time interval in which the part of the control signal due to proportional action 
increases by an amount equal to the part of the control signal due to derivative action 
when the error is changing at a constant rate’ (BS 1523). 

Equation (4.91) can also be expressed as 


U(s) 


K\{T t T d s 2 + TjS+l) 
T,s 


E(s) 


(4.92) 


4.5.5 The Ziegler-Nichols methods for tuning PID controllers 

The selection of the PID controller parameters K \ , 7) and T d can be obtained using 
the classical control system design techniques described in Chapters 5 and 6. In the 
1940s, when such tools were just being developed, Ziegler and Nichols (1942) devised 
two empirical methods for obtaining the controller parameters. These methods are 
still in use. 

(a) The Process Reaction Method: This is based on the assumption that the open- 
loop step response of most process control systems has an S-shape, called the process 
reaction curve, as shown in Figure 4.29. The process reaction curve may be approxi- 
mated to a time delay D (also called a transportation lag) and a first-order system of 
maximum tangential slope R as shown in Figure 4.29 (see also Figure 3.13). 

The Process Reaction Method assumes that the optimum response for the closed- 
loop system occurs when the ratio of successive peaks, as defined by equation (3.71), 
is 4:1. From equation (3.71) it can be seen that this occurs when the closed-loop 
damping ratio has a value of 0.21. The controller parameters, as a function of R and 
D, to produce this response, are given in Table 4.2. 



Fig. 4.29 Process reaction curve. 
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Table 4.2 Ziegler-Nichols PID parameters using the 
Process Reaction Method 


Controller type 

N 

T; 

T A 

p 

1 /RD 

- 

— 

pi 

0.9/RD 

D/ 0.3 

- 

PID 

1.2/RD 

2D 

0.5 D 

Table 4.3 Ziegler-Nichols PID parameters using the 

Continuous Cycling Method 



Controller type 

Kx 

T, 

T A 

p 

KJ2 

— 

— 

pi 

KJ2.2 

TJX. 2 

- 

PID 

KJX.l 

TJ2 

TJ8 


Note that the Process Reaction Method cannot be used if the open-loop step 
response has an overshoot, or contains a pure integrator(s). 

(b) The Continuous Cycling Method : This is a closed-loop technique whereby, 
using proportional control only, the controller gain K\ is increased until the system 
controlled output c(t) oscillates continually at constant amplitude, like a second- 
order system with no damping. This condition is referred to as marginal stability 
and is discussed further in Chapters 5 and 6. This value of controller gain is called 
the ultimate gain K u , and the time period for one oscillation of c(t) is called the 
ultimate period T u . The controller parameters, as a function of K u and T u , to provide 
a similar closed-loop response to the Process Reaction Method, are given in 
Table 4.3. 

The two Ziegler-Nichols PID tuning methods provide a useful ‘rule of thumb’ 
empirical approach. The control system design techniques discussed in Chapters 5 
and 6 however will generally yield better design solutions. 

Of the two techniques, the Process Reaction Method is the easiest and least 
disruptive to implement. In practice, the measurement of R and D is very subjective, 
and can lead to errors. 

The Continuous Cycling Method, although more disruptive, has the potential to 
give better results. There is the risk however, particularly with high performance 
servo-mechanisms, that if K n is increased by accident to slightly above the marginal 
stability value, then full instability can occur, resulting in damage to the system. 

Actuator saturation and integral wind-up 

One of the practical problems of implementing PID control is that of actuator 
saturation and integral wind-up. Since the range of movement in say, a control valve, 
has physical limits, once it has saturated, increasing the magnitude of the control 
signal further has no effect. However, if there is a difference between desired and 
measured values, the resulting error will cause a continuing increase in the integral 
term, referred to as integral wind-up. When the error term changes its sign, the 
integral term starts to ‘unwind,’ and this can cause long time delays and possible 
instability. The solution is to limit the maximum value that the integral term 
can have. 
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4.5.6 Proportional plus Derivative (PD) control 

Proportional plus Derivative control action is expressed as 

de 

u(t) = K\e(t) + K 3 , (4.93) 

at 

Taking Laplace transforms 

U(s) = K^\+^j E(s) 

= K x {\ + T d s)E(s) (4.94) 

The inclusion of a derivative term in the controller generally gives improved damping 
and stability. This is discussed in more detail in Chapters 5 and 6. 


4.6 Case study examples 


Example 4.6.1 CNC Machine-Tool Positional Control (See also Appendix 1, 
examp461.m) 

The physical configuration and block diagram representation of a CNC machine- 
tool is shown in Figures 1.10 and 1.11. The fundamental control problem here is that, 
by design, the lead-screw (by the use of re-circulating ball-bearings) is friction-free. 
This means that the positional control system will have no damping, and will oscillate 
continuously at the undamped natural frequency of the closed-loop system. 

Damping can be introduced in a number of ways: 

(a) A dashpot attached to the lead-screw. This is wasteful on energy and defeats the 
objective of a friction-free system. 

(b) Velocity feedback : A signal from a sensor that is the first derivative of the 
output (i.e. velocity) will produce a damping term in the closed-loop transfer 
function. 

(c) PD control : A PD controller will also provide a damping term. Flowever, the 
practical realization will require an additional filter to remove unwanted high 
frequency noise (see Chapter 6 for further details on lead-lag compensation). 

Most machine-tool manufacturers employ velocity feedback to obtain the necessary 
damping. Since overshoot in a cutting operation usually cannot be tolerated, the 
damping coefficient for the system must be unity, or greater. 

For this study, the machine-tool configuration will be essentially the same as 
shown in Figure 1.10, with the exception that: 

(i) A gearbox will be placed between the servo-motor and the lead-screw to provide 
additional torque. 

(ii) The machine table movement will be measured by a linear displacement trans- 
ducer attached to the table. This has the advantage of bringing the table ‘within 
the control-loop’ and hence providing more accurate control. 
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System element dynamic equations : With reference to Figures 1.11 and 4.31 

1. Controller 


Proportional control, gain A)(V/m) 
Control signal LhCs) = K\{X<±{s) — W m (V)) 


2. Power amplifier 

Gain AT 2 (V/V) 

Control signal U 2 (s ) = Ar 2 (f7i(.y) — B 2 (s)) 


(4.96) 


3. DC servo-motor-. Field controlled, with transfer function as shown in Figure 4.17. 
It will be assumed that the field time constant Lf/Rf is small compared with the 
dynamics of the machine table, and therefore can be ignored. Hence, DC servo- 
motor gain K 2 (Nm/V). 

Motor Torque T m (s) = Ah U 2 (s) (4.97) 

4. Gearbox, lead-screw and machine-table : With reference to Figure 2.9 (free-body 
diagram of a gearbox), the motor-shaft will have zero viscous friction C m , hence 
equation (2.22), using Laplace notation, becomes 

X(s) = - a (T m (s) - I m s 2 d m (s)) (4.98) 

The output shaft in this case is the lead screw, which is assumed to have zero moment 
of inertia I Q and viscous friction C 0 . The free-body diagrams of the machine-table 
and lead-screw are shown in Figure 4.30. 

For lead-screw 

Work in = Work out 
bX(t)6 0 (t) = F(t)x 0 (t) 
or 

F(t) = bX(t) e ^ (4.99) 

*o(0 


^X 0 (f}, X a (t), X 0 (f) 

m 





Fig. 4.30 Free-body diagrams of lead-screw and machine-table. 
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Now the pitch p of the lead-screw is 


o o 

K ^ 

II 

(4.100) 

Substituting (4.100) into (4.99) 


II 

(4.101) 

p 


The equation of motion for the machine-table is 


F(t) = mx 0 

(4.102) 

Equating (4.101) and (4.102) gives 


X(t) = ^ (pmx Q ) 


Taking Laplace transforms 


X(s) = ^ ( pms 2 X Q (s)) 

(4.103) 

Equating (4.98) and (4.103) gives 


pms 2 X 0 (s ) = ^ {T m (s) - I m s 2 6 m (s)) 

(4.104) 

Now 


b/a = gear ratio n 

0m(s) = n0 o (s) 


Hence 


s 2 0 m (s) = ns 2 0 o (s ) 


and 


0 , , X 0 (s) 

0 o (s) = 

(4.105) 


Equation (4.105) can be substituted into (4.104) 

7 n 7 

pms X 0 (s) = nT m (s ) - nl m -s X 0 (s) 

P 


or 


nT m (s) 



(4.106) 


giving the transfer function for the gearbox, lead-screw and machine-table as 


X 0 

T m 


(s) 


n 

(pm + n 2 I m /p)s 2 


(4.107) 


where the term n 2 I m / P may be considered to be equivalent mass of 7 m referred to the 
machine-table. 
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5. Tachogenerator 


Gain H 2 (Vs/rad) 
Feedback signal B 2 (s) = H 2 s0 o (s) 


or, from equation (4.105) 


Ih(s) 


— sX a (s) 
P 


6. Position transducer 

Gain H\ (V/m) 

Feedback signal X m (s) = H[X 0 (s) 


(4.108) 


(4.109) 


(4.110) 


The system element dynamic equations can now be combined in the block diagram 
shown in Figure 4.31. Using equation (4.4), the inner-loop transfer function is 


G(s) 


K 2 Kjnp 

(p 2 m + n 2 I m )s + KiK^nHi 


(4.111) 


Again, using equation (4.4), the overall closed-loop transfer function becomes 


Ao KpKjKpnp 

Xd S ( p 2 m + n 2 I m )s 2 + K 2 K 2 nH 2 s + K\K 2 K 2 npH\ 


(4.112) 


which can be written in standard form 


To 

Xd 


(s) 




p 2 m+n 2 I m 

K,K 2 K 3 npH, 



V+ 1 


(4.113) 



Position Transducer 


Fig. 4.31 Block diagram of CNC machine-tool control system. 
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Specification : The CNC machine-table control system is to be critically damped with 
a settling time of 0.1 seconds. 

Control problem : To select the controller gain K\ to achieve the settling time and 
tachogenerator constant to provide critical damping. 

System parameters 

K 2 = 2 V/V Kj = 4Nm/V 
n = 10 : 1 p = 5 x 10~ 3 m 

m = 50 kg 7 m = 10 x 10~ 6 kgm 2 

Hi = 60 V/m 

Calculation of K\ : In general, the settling time of a system with critical damping is 
equal to the periodic time of the undamped system, as can be seen in Figure 3.19. 
This can be demonstrated using equation (3.62) for critical damping 

.%- o (0 = [l-e-“ n '(l+uV)] 

when 


t = 27r/w n 

* o (0 = [1 - e- 2 *(l + 2 tt)] 

= 0.986 (4.114) 


Thus, for a settling time of 0.1 seconds for a system that is critically damped, the 
undamped natural frequency is 


LU n 


— = 62.84 rad/s 
0.1 


(4.115) 


Comparing the closed-loop transfer function given in equation (4.113) with the 
standard form given in (3.42) 


f KffKpipHC 
V P 2,n + ” 2/ m ) 


(4.116) 


Hence 


_ (jfm + n 2 I m )u>l 
1 “ K 2 K 3 npHi 

= {(5 x 10~ 3 ) 2 x 50} + (10 2 x 10 x 1 0 6 ) 1 2 

(2 x 4 x 10 x 5 x 10 -3 x 60) 

= 0.365 V/V (4.117) 

Again, comparing equation (4. 113) with the standard form (3.42) 

2C H 2 


w n K\pH 1 


(4.118) 



Closed-loop control systems 97 


Hence 

„ 2C^K\pH | 
n 2 = 

Wn 

2 x 1 x 0.365 x 5 x 10~ 3 x 60 
= 62.84 

= 3.485 x 10~ 3 Vs/rad (4.119) 


Example 4.6.2 Temperature control system (See also Appendix 1, examp462.m) 
The general form of a temperature control system is shown in Figure 1.6 with the 
corresponding block diagram given in Figure 1.7. 

The system variables are: 

8 d (t) = Desired temperature (°C) 

6 m ( t) = Measured temperature (V) 

9 0 (t) = Actual temperature (°C) 

9 s (t) = Temperature of surroundings (°C) 
u( t) = Control signal (v) 
i>( t) = Gas flow-rate (m 3 /s) 

Qi(t) = Heat flow into room (J/s = W) 

Q 0 (t ) = Heat flow though walls (W) 

System equations 

1. Controller. The control action is PID of the form given in equation (4.91) 

U(s) = K^ 1 + ^ + T d .?j (d d (s) - 9 m {s)) (4. 120) 

2. Gas solenoid valve : This is assumed to have first-order dynamics of the form 


V 

~U 


(■*) 


k 2 

1 + T\s 


where K 2 is the valve constant (m 3 /s V). 


3. Gas burner. This converts gas flow-rate v(t) into heat flow Qi(t) i.e.: 


(4.121) 


Q,(s) = K 3 V (s) (4.122) 

where K 2 is the burner constant (Ws/m 3 ). 

4. Room dynamics : The thermal dynamics of the room are 

c\0 

QM - Qo(t) = C T ^ (4.123) 

Equation (4.123) is similar to equation (2.54), where Cj is the thermal capacitance 
of the air in the room. 
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The heat flow through the walls of the building is as given in equation (2.53), i.e. 

OWO - 0.(0) 


Qo(t) = 


Ri 


where Rj is the thermal resistance of the walls, see equation (2.47). 
Substituting equation (4.124) into (4.123) gives 

%(t) ~ 0 S (O' N 


Gt(0 - 

Multiplying through by Rj 


Ri 


= Cj ~di 


RjQiit ) + 0,(0 = 0 o (O + ^tC t 


ddo 

dr 


(4.124) 


(4.125) 


(4.126) 


Taking Laplace transforms 

RjQi(s) + 0,(0 = (1 + /J T C T O0o(O (4-127) 

Equation (4. 127) can be represented in block diagram form as shown in Figure 4.32. 
5. Thermometer. The thermometer equation is 

0 m (s) = H 1 0 o {s) (4.128) 

The complete block diagram of the temperature control system is shown in Figure 
4.33. 

From Figure 4.33 


KtKiKiRjjTiTas 2 + 7> + l)(0 d (Q - H { 6 0 (Q) 
T,s( 1 + nO 


+ 0,(0 = (1 + ^ t CtO0o(O (4. 129) 


0,(s) 


Q(s) 


1 

L+ 

1 

0o(s) 


''T 


1 + RjCjS 



Fig. 4.32 Block diagram representation of the thermal dynamics of the room. 



Fig. 4.33 Block diagram of temperature control system. 
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Equation (4.129) can be re-arranged to give 

ir, (7) T d s 2 + T iS + l)0 d (j) + o s(s) 


0 o (s) = 


(Br)^ 3 + (^P+ r i T d )s 2 + T t ( 


wu ;+ 1)^+1 


where the forward-path gain Kp is 

K f = K i Ki Kt, Rj 


(4.130) 


(4.131) 


Control problem-. Given the system parameters, the control problem is to determine 
the controller settings for K \ , T\ and T d . This will be undertaken using the Zeigler- 
Nichols process reaction method described in Section 4.5.5(a). 

System parameters: 

K 2 Kt, = 5 W/V Rj = 0.1 Ks/J 
C T = 80 J/K Hi = 1.0 V/K 
T\ = 4 seconds 


Process reaction curve : This can be obtained from the forward-path transfer function 


0 o ( _ K 2 K 3 R t 
U {S) (1 + 7,^(1 + RjCjs) 


(4.132) 


Inserting values into equation (4.132) gives 


c7 W = (T 


0.5 


4.0(1 + 8 s) 


( 4 . 133 ) 


Figure 4.34 shows the response to a unit step, or the process reaction curve. 

From the R and D values obtained from the process reaction curve, using the 
Zeigler-Nichols PID controller settings given in Table 4.2 


K\ = 1.2 /RD = 26.144 
7) = 2D = 3.0 seconds 
7~d = 0.5 D = 0.75 seconds 


Assuming that the temperature of the surroundings 9 s (t) remains constant, the 
closed-loop transfer function (using equation (4.130)) for the temperature control 
system, is 


do, (2.25s 1 + 3 ^+ 1 ) 

9 d ' S ~ 7 . 344.? 3 + 5 . 004 . V 2 + 3 . 229 ^ + 1 


( 4 . 134 ) 


The response to a step change in the desired temperature of 0-20 °C for the closed- 
loop transfer function given by equation (4.134) is shown in Figure 4.35. 

From Figure 4.35, the ratio of successive peaks is 


a 2 


8.92 

F98 


= 4.5 


( 4 . 135 ) 
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Fig. 4.34 Process reaction curve for the temperature control system shown in Figure 4.33. 



Fig. 4.35 Closed-loop step response of temperature control system using PID controller tuned using 
Zeigler- Nichols process reaction method. 

This corresponds to a damping ratio of 0.23. These values are very close to the 
Zeigler-Nichols optimum values of 4.0 and 0.21 respectively. 

Example 4.6.3 Ship Autopilot (See also Appendix 1, examp463.m ) 

A ship has six degrees-of-freedom, i.e. it is free to move in six directions simultan- 
eously, namely three linear motions - surge (forward), sway (lateral) and heave 
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(vertical) together with three rotational motions - roll, pitch and yaw. This analysis 
considers rotation about the yaw axis (i.e. heading control) only. 

Figure 1.12 shows a typical ship autopilot system and Figure 1.13 shows the 
corresponding block diagram. Rotation about the yaw axis is in effect rotation about 
the z, or vertical axis of the vessel, called the V’ direction since r is the symbol for 
yaw-rate. Hence hydrodynamic coefficients for the yaw axis are therefore given the 
subscript V. Yaw hydrodynamic coefficients are given the symbol ' N\ In this 
analysis the dynamics of the steering gear are neglected. 

The system variables are 

\E' d (?) = Desired heading (radians) 
vj/ a (?) = Actual heading (radians) 

6( t) = Rudder angle (radians) 

Figure 4.36 shows the hull free-body diagram. Disturbance effects (wind, waves and 
current) are not included. 

System equations 

1. Hull dynamics’. In Figure 4.36, X 0 Y 0 is the earth co-ordinate system where X Q is 
aligned to north. All angles are measured with respect to X Q . A consistent right- 
hand system of co-ordinates is used, with the exception of the rudder-angle, which 
has been selected to be left-hand to avoid negative coefficients in the hull transfer 
function. 



Fig. 4.36 Free-body diagram of ship hull dynamics. 
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From Figure 4.36 the equation of motion for the yaw axis is 

X> G = / Z &(0 

(.Ng6(t)) - (. N r 1p a (t )) = ijp . a (0 


Taking Laplace transforms 

A^O) = (7 Z ^ 2 + N r s)ip a (s) 
Flence the hull transfer function becomes 


i’a. 

6 


(s) 


N 6 

s(I z s + N r ) 


(4.136) 


(4.137) 


(4.138) 


2. Control action-. In this case, the autopilot (controller) is considered to provide 
proportional control only. 


6(s) = Ki(i/j d (s) - tp a (s)) 


(4.139) 


3. Gyro-compass'. This provides a measured heading proportional to the actual 
heading 


ip m (s) = Help -As) 


(4.140) 


Combining equations (4.138), (4.139) and (4.140) produces the block diagram shown 
in Figure 4.37. 

Using equation (4.4), the closed-loop transfer function is 


K,K 2 N s 

s(I z S+N r ) 

1 I K 1 K 2 N s H i 
1 + s(I z s+N r ) 


Equation (4.141) simplifies to give 


Hi 


V’d f h ,'\o2 + ( N± 

\KiK 1 N s Hi) l> + \KiK 2 N s Hi)^ ^ 1 


(4.141) 


(4.142) 



Fig. 4.37 Block diagram of ship autopilot control system. 
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Equation (4.142) is in the standard form given in equation (3.42). 

Control problem : For a specific hull, the control problem is to determine the autopilot 
setting ( K \ ) to provide a satisfactory transient response. In this case, this will be when 
the damping ratio has a value of 0.5. Also to be determined are the rise time, settling 
time and percentage overshoot. 

System parameters'. The ship to be controlled is a cargo vessel of length 161 m with a 
MARINER type hull of total displacement 17 000 tonnes. 

K 2 = 1.0 rad/V N s = 80 x 10 6 Nm/rad 

N r = 2 x 10 9 Nms/rad I z = 20 x 10 9 kgm 2 
Hi = l.OV/rad 


Inserting values into equation (4.142) gives 




(s) 


which simplifies to 



(4.143) 


(4.144) 


Comparing equation (4.144) with the standard form given in equation (3.42) 


1 250 

u>l K { 


(4.145) 


2C_ 25 
W n Ki 


(4.146) 


Given that ( = 0.5, then from equation (4.146) 

Kx 
A 

Substituting (4.147) into (4.145) gives 

25 2 

Kf 


25 

250 


(4.147) 


Hence 


K\ = 


625 

250 


= 2.5 


(4.148) 


and from equation (4.147), 
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Fig. 4.38 Unit step response of ship autopilot control system. RiseTime (to 95%) = 23 seconds; 
Percentage Overshoot = 16.3%; 

Settling time (to ±2%) = 81 seconds. 


From equations (3.58) and (3.59) the unit step response for the ship autopilot control 
system is given by the expression 

ip a (t) = 1 -e' 0 05r ( cos 0.0866f + 0.577 sin 0.0866?) (4.150) 

Figure 4.38 shows the system unit step response. From Figure 4.38 


4.7 Further problems 


Example 4.7 

For the block diagrams shown in Figure 4.39 find an expression for the complete 
output when all inputs act simultaneously. 

Solutions 

, \ rl n _ (C7i (.s)G 2 (-y)G3(-y))i?i (x) + GbfoXl + G 2 (s)H 3 (s))R 2 (s) 
ta; t(S]-| + g 3 (s)H 2 (s) + G 2 (s)H 3 (s) + G\(s)G 2 (s)G 3 (s)IG (s) 

r( . _ (gj (s)G 2 U)G 3 (s)G^s))Ri (s) - (Cl (s)G 2 (s)G 3 (s)G 4 (s)H i (s))R 2 (s) - (G 3 {s)G 4 (s))Rj(s) 

l + G 3 (s)H 2 (s) + Gi(s)G2(s)(h(s)G4(s)Hi(,s) 

Example 4.8 

The speed control system shown in Figure 4.40 consists of an amplifier, a field- 
controlled DC servomotor and a tachogenerator. The load consists of a mass of 
moment of inertia I and a fluid damper C. The system parameters are: 

/ = 0.75 kg m 2 C = 0.5Nms/rad 
K 2 = 5 Nm/A Hi = 0.1 Vs/rad 
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(a) 



Fig. 4.39 Block diagrams for closed-loop systems. 

Amplifier l a = constant 



Find the value of K\ to give the system a closed-loop time constant of one second. 
What is the steady-state value of uj Q (t) when v; (t) has a value of 10 V. 

Solution 
0.5 A/V 
33.3 rad/s 


to 
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Fig. 4.41 Angular positional control system. Ki = Error detector gain (V/rad); K 2 = Amplifier gain (A/V); 
K3 = Motor constant (Nm/A); n = Gear ratio; Hi = Tachogenerator constant (V s/rad); / G = Load moment 
of inertia (kg m 2 ); C 0 = Load damping coefficient (Nms/rad). 


Example 4.9 

Find an expression for the closed-loop transfer function relating 0j(y) and 9 0 (s) for 
the angular positional control system shown in Figure 4.41. 


Solution 


0O M 

^ (5)= 




( C 0 +K2K 3 n 2 H, \ 
\ K x K 2 K in I 


S+ 1 


Example 4.10 

A hydraulic servomechanism consists of the spool-valve/actuator arrangement 
shown in Figure 4.19 together with a ‘walking beam’ feedback linkage as shown in 
Figure 4.42. The spool-valve displacement x v (t) is given by the relationship 



Fig. 4.42 Hydraulic servomechanism with 'walking beam' feedback linkage. 
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Fig. 4.43 Block diagram of a servomechanism. 


= (tt d ” (0 ~ 

If the forward-path transfer function is given by equation (4.57), find an expression for 
the closed-loop transfer function relating X { (s) and A 0 (s). The system parameters are 

/n = 50 kg F t = 4xl0~ 3 m 3 /3=1.4GPa 

A = 0.01 m 2 K q = 10.0 nr/s K c = 6 x 10~ 9 m 5 /Ns 

C p = 6 x 10~ 9 m 5 /Ns a = b = 0.15m 


Solution 


i'o,, 

* (i) 


500 

0.357 x 10- 6 s 3 + 0. 12 x lO-V + s + 500 


Example 4.11 

A servomechanism consists of an amplifier, actuator and sensor as shown in block 
diagram form in Figure 4.43. If the input to the system is a constant velocity of the 
form 


0i(t) = 2 1 

find an expression for the time response of the system. 
Solution 


f) 0 (t) = 0.667 1 - 0.0222 + e"'(0.0222 cos 7.68/ - 0.083 sin 7.68/) 


Example 4.12 

Figure 4.44 shows the elements of a closed-loop temperature control system. A 
proportional controller compares the desired value 6[{t) with the measured value 
v 0 (?) and provides a control signal u(t ) of K\ times their difference to actuate the valve 
and burner unit. The heat input to the oven Q[{t) is A3 times the control signal. 
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Proportional 



Fig. 4.44 Closed-loop temperature control system. 


The walls of the oven have a thermal resistance Rj and the oven has a thermal 
capacitance Cj and operating temperature 0 o {t). The heat transfer equation for the 
oven may be written 


QM 


0 o (t) _ d0 o 
R t T dr 


The thermometer and measurement system feed a measured value of H \ times 0„(i) to 
the controller. The system parameters are 


Ki = 5 K 2 = 1.5 J/V Hi = 1 V/K 
Rj = 2 K/J C T = 25 Js/W 


Find 

(a) The open-loop time constant 

(b) The closed-loop time constant 

(c) The percentage steady-state error in the output when the desired value is con- 
stant. 

Solution 

(a) 50 seconds 

(b) 3.125 seconds 

(c) 6.25% 

Example 4.13 

Figure 4.45 shows the block diagram representation of a process plant being con- 
trolled by a P1D controller. 

(a) Find an expression for the complete response C(.v) when R \ (.v) and R 2 (s) act 
simultaneously. 

(b) Using the Ziegler-Nichols Process Reaction Method, determine values for K\, T\ 
and 7d when T\ = 10 seconds and T 2 = 20 seconds. 
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Fig. 4.45 Process plant under PID control. 


(c) Insert the values into the expression found in (a). Using MATLAB, or otherwise, 
determine the response c(t) when r\{t) is a unit step and r 2 (t) is zero. What is the 
ratio of successive peaks? 

Solution 


(a) C(s) 


KiiT.TiS 2 + T iS + l)tfi(s) + TisR 2 (, s) 

TiTi T 2 s 3 + Ti{T\ + T 1 + K ] T d ) s 2 + T,(l + Ki)s + K t 


(b) K\ = 17.2 T[ = 6 seconds T d = 1.5 seconds 


(c) C(s) 


ll.2(9s 2 + 6s+l) 

^(1200U + 334.8s 2 + 109.2^+ 17.2) 


2.75 


5 


Classical design in the 
s-plane 


5.1 Stability of dynamic systems 

The response of a linear system to a stimulus has two components: 

(a) steady-state terms which are directly related to the input 

(b) transient terms which are either exponential, or oscillatory with an envelope of 
exponential form. 

If the exponential terms decay as time increases, then the system is said to be stable. If 
the exponential terms increase with increasing time, the system is considered unstable. 
Examples of stable and unstable systems are shown in Figure 5.1. The motions 
shown in Figure 5.1 are given graphically in Figure 5.2. (Note that (b) in Figure 
5.2 does not represent (b) in Figure 5.1.) The time responses shown in Figure 5.2 can 
be expressed mathematically as: 

For (a) (Stable) 



x 0 (t) = Ae al sin(tu? + </>) 

(5.1) 

For (b) (Unstable) 

x Q (t) = Ae a ‘ sin (cet + (j>) 

(5.2) 

For (c) (Stable) 

b 

1 

<D 

II 

O 

* 

(5.3) 

For (d) (Unstable) 

x 0 (t) = Ae at 

(5.4) 

From equations (5. 1) (5.4), it can be seen that the stability of a dynamic system 
depends upon the sign of the exponential index in the time response function, which 
is in fact a real root of the characteristic equation as explained in section 5.1.1. 
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Fig. 5.2 Graphical representation of stable and unstable time responses. 
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5.1.1 Stability and roots of the characteristic equation 

The characteristic equation was defined in section 3.6.2 for a second-order system as 

as 2 + bs + c — 0 (5.5) 


The roots of the characteristic equation given in equation (5.5) were shown in section 
3.6.2. to be 


S U S 2 = 


—b ± Vb 2 — 4 ac 

2 a 


(5.6) 


These roots determine the transient response of the system and for a second-order 
system can be written as 

(a) Overdamping 


(b) Critical damping 


si = -a i 


S2 = -02 


(c) Underdamping 


= Si = — cr 


(5.7) 


(5.8) 


Si, S 2 = — cr± jw (5.9) 

If the coefficient b in equation (5.5) were to be negative, then the roots would be 

S\, S 2 = +er±j u) (5.10) 

The roots given in equation (5.9) provide a stable response of the form given in 
Figure 5.2(a) and equation (5.1), whereas the roots in equation (5.10) give an 
unstable response as represented by Figure 5.2(b) and equation (5.2). 

The only difference between the roots given in equation (5.9) and those in equation 
(5.10) is the sign of the real part. If the real part a is negative then the system is stable, 
but if it is positive, the system will be unstable. This holds true for systems of any 
order, so in general it can be stated: ‘If any of the roots of the characteristic equation 
have positive real parts, then the system will be unstable’. 


5.2 The Routh-Hurwitz stability criterion 

The work of Routh (1905) and Hurwitz (1875) gives a method of indicating the 
presence and number of unstable roots, but not their value. Consider the character- 
istic equation 


a„s" + a„-\f 1 + • • • + ci\s + ciq = 0 


(5.11) 
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The Routh-Hurwitz stability criterion states: 

(a) For there to be no roots with positive real parts then there is a necessary, but not 
sufficient, condition that all coefficients in the characteristic equation have the 
same sign and that none are zero. 

If (a) above is satisfied, then the necessary and sufficient condition for stability is either 

(b) all the Hurwitz determinants of the polynomial are positive, or alternatively 

(c) all coefficients of the first column of Routh’s array have the same sign. The 
number of sign changes indicate the number of unstable roots. 

The Hurwitz determinants are 



D x 

= 01 

d 2 = 

01 

0 O 

03 

02 







01 

03 

05 

07 

Cl\ 

03 

0 5 


0 O 

02 

04 

<26 

do 

02 

04 

d 4 = 


01 

03 

05 


01 

03 




02 

04 


(5.12) 


Routh’s array can be written in the form shown in Figure 5.3. 
In Routh’s array Figure 5.3 


l 

0«— 1 

An— 3 

@n — i 

d n 

0/i— 2 

l 

Cl = — 

b\ 

t>2 

b i 

0«— l 

@n— 3 


b 2 = 


1 

a n -\ 


@n— I An— 5 

Ctyi dn — 4 


etc. 


C2 = T~ 
b 1 


b\ b 3 

dn~ 1 An— 5 


etc. 


(5.13) 

(5.14) 


Routh’s method is easy to apply and is usually used in preference to the Hurwitz 
technique. Note that the array can also be expressed in the reverse order, commen- 
cing with row s n . 


Pi 


Ci 

Pi 

3/7-1 

3/7 


3/7-3 

a n - 2 


3/7-5 

3/7-4 


Fig. 5.3 Routh's array. 
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Example 5.1 (See also Appendix 1, A1.5) 

Check the stability of the system which has the following characteristic equation 

s 4 + 2s 3 + s 2 + 4s + 2 = 0 (5.15) 

Test T. All coefficients are present and have the same sign. Proceed to Test 2, i.e. 
Routh’s array 


2 (5.16) 

4 

1 2 



The bottom two rows of the array in (5.16) are obtained from the characteristic 
equation. The remaining coefficients are given by 




2 4 
1 1 


= 2 (2 - 4) = -l 


* 2 = 2 


2 0 

1 2 


= -(4-0) = 2 


ci = -1 


b 3 = 0 


-1 2 
2 4 


= — 1(— 4 — 4) = 


c 2 = 0 


cl i = 


8 0 

-1 2 


= 4 ( 16 - 0 ) = 2 


(5.17) 

(5.18) 

(5.19) 

(5.20) 

(5.21) 

(5.22) 


In the array given in (5. 16) there are two sign changes in the column therefore there 
are two roots with positive real parts. Hence the system is unstable. 


5.2.1 Maximum value of the open-loop gain constant for the 
stability of a closed-loop system 


The closed-loop transfer function for a control system is given by equation (4.4) 


£ (s) = G{s) 

R ’ 1 + G(s)H(s) 


(5.23) 


In general, the characteristic equation is most easily formed by equating the denomi- 
nator of the transfer function to zero. Hence, from equation (5.23), the characteristic 
equation for a closed-loop control system is 

1 + G(s)H(s) = 0 


(5.24) 



Classical design in the s-plane 1 1 5 


Proportional Control 

Controller Valve Plant 



Fig. 5.4 Closed-loop control system. 


Example 5.2 (See also Appendix 1, examp52.ni) 

Find the value of the proportional controller gain K\ to make the control system 
shown in Figure 5.4 just unstable. 

Solution 

The open-loop transfer function is 



(5.25) 

The open-loop gain constant is 


II 

oo 

(5.26) 

giving 


GWHW = ^/ i+ 2) 

(5.27) 

From equation (5.24) the characteristic equation is 


1 + , K = 0 
^(^ 1 2 + s + 2) 

(5.28) 

or 


,s(.r + ^ + 2) + A: = 0 

(5.29) 

which can be expressed as 


■s 3 + s 2 + 2s + K = 0 

(5.30) 


The characteristic equation can also be found from the closed-loop transfer function. 
Using equation (4.4) 

g(,) = 

R J 1 + G(s)H(s) 


Given the open-loop transfer function in equation (5.27), where H(s) is unity, then 


C 

R 


(s) 


K 

i(.5 2 +.S+2) 

1 I * 

' s(s 2 +.s+2) 


(5.31) 
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Multiplying numerator and denominator by s(s 2 + s + 2) 


C 

R 


(s) 


K 

5(5 2 + 5 + 2) + A' 


(5.32) 


-( S ) = 

5 3 + 5 2 + 25 + A 

Equating the denominator of the closed-loop transfer function to zero 

s 3 + s 2 + 2s + K = 0 


(5.33) 


(5.34) 


Equations (5.30) and (5.34) are identical, and both are the characteristic equation. It 
will be noted that all terms are present and have the same sign (Routh’s first 
condition). Proceeding straight to Routh’s array 


where 


5 ° K 

s l (2 - A) 

s 1 1 K 

s 3 1 2 


b\ 


1 K 
1 2 


(2 - A) 


b 2 = 0 
ci =K 


(5.35) 


To produce a sign change in the first column, 

A > 2 (5.36) 

Hence, from equation (5.26), to make the system just unstable 

K\ = 0.25 

Inserting (5.36) into (5.30) gives 

+ s 2 + 2s + 2 = 0 

factorizing gives 

fr + 2 )(. s + 1) = 0 

hence the roots of the characteristic equation are 

5= -1 

5 = 0 ±jV2 

and the transient response is 

c(t) = Ae~‘ + B sin(\/2? + </>) (5.37) 

From equation (5.37) it can be seen that when the proportional controller gain K\ is 
set to 0.25, the system will oscillate continuously at a frequency of \/2 rad/s. 
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5.2.2 Special cases of the Routh array 

Case 1: A zero in the first column 

If there is a zero in the first column, then further calculation cannot normally proceed 
since it will involve dividing by zero. The problem is solved by replacing the zero with 
a small number e which can be assumed to be either positive or negative. When the 
array is complete, the signs of the elements in the first column are evaluated by 
allowing e to approach zero. 

Example 5.3 

s 4 + 2s 3 + 2s 2 + 4s + 3 = 0 

s° 3 

.v 1 4 - 6/e 

s 2 e 3 (5.38) 

s 3 2 4 

s 4 1 2 3 

Irrespective of whether e is a small positive or negative number in array (5.38), there 
will be two sign changes in the first column. 


Case 2; All elements in a row are zero 

If all the elements of a particular row are zero, then they are replaced by the 
derivatives of an auxiliary polynomial, formed from the elements of the previous row. 


Example 5.4 

s 5 + 2s 4 + 6s 3 + 12s 2 + 8s + 16 = 0 

s° 16 

.v 1 8/3 

s 1 6 16 

s 3 8 24 

s 4 2 12 16 

s 5 16 8 


(5.39) 


The elements of the .r 3 row are zero in array (5.39). An auxiliary polynomial P(s) is 

therefore formed from the elements of the previous row (s 4 ). 

i.e. 

Pis) = 2 s 4 + 12s 2 + 16 

= 8 s 3 + 24s (5.40) 

The coefficients of equation (5.40) become the elements of the s 3 row, allowing the 
array to be completed. 
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5.3 Root-locus analysis 
5.3.1 System poles and zeros 

The closed-loop transfer function for any feedback control system may be written in 
the factored form given in equation (5.41) 

C G'(.v) _ K c js - z c \ )(j - z c2 ) ...(s- z c „ ) 

R ~ 1 + G(s)H(s) ~ {s - p c \)(s - p c2 ) ...is- p m ) ’ 

where 5 = p c \, p c2 , ■ ■ ■ , Pen are closed-loop poles, so called since their values make 
equation (5.41) infinite (Note that they are also the roots of the characteristic 
equation) and s = z c i, z C 2 , . . . , z cn are closed-loop zeros, since their values make 
equation (5.41) zero. 

The position of the closed-loop poles in the .v-plane determine the nature of the 
transient behaviour of the system as can be seen in Figure 5.5. Also, the open-loop 
transfer function may be expressed as 

= (5.42) 

is - P 0 l)is - p 02 ) . . . is - p Qn ) 

where r 0 i, z 02 , . . ., z 0 „ are open-loop zeros and p 0 1 , p 02 , . . . , po„ are open-loop poles. 



Fig. 5.5 Effect of closed-loop pole position in the s-plane on system transient response. 
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5.3.2 The root locus method 

This is a control system design technique developed by W.R. Evans (1948) that 
determines the roots of the characteristic equation (closed-loop poles) when the 
open-loop gain-constant K is increased from zero to infinity. 

The locus of the roots, or closed-loop poles are plotted in the s-plane. This is a 
complex plane, since s = a ± jw. It is important to remember that the real part a is 
the index in the exponential term of the time response, and if positive will make the 
system unstable. Hence, any locus in the right-hand side of the plane represents an 
unstable system. The imaginary part lo is the frequency of transient oscillation. 

When a locus crosses the imaginary axis, a = 0. This is the condition of marginal 
stability, i.e. the control system is on the verge of instability, where transient oscilla- 
tions neither increase, nor decay, but remain at a constant value. 

The design method requires the closed-loop poles to be plotted in the s-plane as K 
is varied from zero to infinity, and then a value of K selected to provide the necessary 
transient response as required by the performance specification. The loci always 
commence at open-loop poles (denoted by x) and terminate at open-loop zeros 
(denoted by o) when they exist. 

Example 5.5 

Construct the root-locus diagram for the first-order control system shown in 
Figure 5.6. 

Solution 

Open-loop transfer function 

G(s)H{s) = K (5.43) 

Ts 

Open-loop poles 

s = 0 

Open-loop zeros: none 
Characteristic equation 

1 + G(s)H(s ) = 0 

Substituting equation (5.3) gives 

<4=o 

i.e. Ts+K=0 (5.44) 



Fig. 5.6 First-order control system. 
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Fig. 5.7 Root-locus diagram for a first-order system. 


Roots of characteristic equation 



(5.45) 


When K is varied from zero to infinity the locus commences at the open-loop pole 
j = 0 and terminates at minus infinity on the real axis as shown in Figure 5.7. 

From Figure 5.7 it can be seen that the system becomes more responsive as K is 
increased. In practice, there is an upper limit for K as signals and control elements 
saturate. 


Example 5.6 

Construct the root-locus diagram for the second-order control system shown in 
Figure 5.8. 

Open-loop transfer function 

G(s)H(s) = — (5.46) 
s(s + 4) 


Open-loop poles 


Open-loop zeros: none 
Characteristic equation 


s = 0,-4 


1 + G(s)H(s) = 0 



Fig. 5.8 Second-order control system. 
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Table 5.1 Roots of second-order characteristic 
equation for different values of K 


K 

Characteristic equation 

Roots 

0 

s 2 + 4.s = 0 

^T 

1 

o' 

II 

03 

4 

s 2 + 4s + 4 = 0 

s= —2 ± jO 

8 

s 2 + 4s + 8 = 0 

.? = — 2±j2 

16 

s 2 + 4.s+ 16 = 0 

s = -2±j3.46 


Substituting equation (5.4) gives 


i.e. 


1 + 


K 


s(s + 4) 


= 0 


4s + K = 0 


(5.47) 


Table 5.1 shows how equation (5.7) can be used to calculate the roots of the 
characteristic equation for different values of K. Figure 5.9 shows the corresponding 
root-locus diagram. 

In Figure 5.9, note that the loci commences at the open-loop poles ( s = 0, —4) 
when K = 0. At K = 4 they branch into the complex space. This is called a break- 
away point and corresponds to critical damping. 



Fig. 5.9 Root locus diagram for a second-order system. 
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5.3.3 General case for an underdamped second-order system 


For the generalized second-order transfer function given in equation (3.43), equating 
the denominator to zero gives the characteristic equation 

s 1 2 + 2(u n s + w 2 = 0 (5.48) 

If C < 1 in equation (5.48), then the roots of the characteristic equation are 

si,s 2 = ~(Mi ±jw n \/l - C 2 (5-49) 

Hence a point P in the s-plane can be represented by Figure 5.10. 

From Figure 5.10, Radius 

OP = ^(-C^+^Vl-C 2 ) 2 (5-50) 


Simplifying (5.50) gives 


Also from Figure 5.10 


OP = U! n 


cos (3 = 


I | 

Wn 


C 


(5.51) 

(5.52) 


Thus, as £ is varied from zero to one, point P describes an arc of a circle of radius u n , 
commencing on the imaginary axis (J3 = 90°) and finishing on the real axis (J3 = 0°). 


Limits for acceptable transient response in the s-plane 

If a system is 

(1) to be stable 

(2) to have acceptable transient response (£ > 0.5) 



Fig. 5.10 Roots of the characteristic equation for a second-order system shown in the s-plane. 
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Fig. 5.1 1 Region of acceptable transient response in the s-plane for ( > 0.5. 


then the closed-loop poles must lie in an area defined by 

(3 = ±cos~' 0.5 = ±60° (5.53) 

This is illustrated in Figure 5.11. 

5.3.4 Rules for root locus construction 

Angle and magnitude criteria 

The characteristic equation for a closed-loop system (5.24) may also be written as 

(i(s)ll(s) = -1 (5.54) 

Since equation (5.54) is a vector quantity, it can be represented in terms of angle and 
magnitude as 

/G(s)H(s) - 180° (5.55) 

\G{s)H(s)\ = 1 (5.56) 


The angle criterion 

Equation (5.55) may be interpreted as ‘For a point si to lie on the locus, the sum of 
all angles for vectors between open-loop poles (positive angles) and zeros (negative 
angles) to point si must equal 180°.’ 

In general, this statement can be expressed as 

E Pole Angles — E Zero Angles = 180° 


(5.57) 
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Fig. 5.12 Application of the angle criterion. 


Example 5.7 

Consider an open-loop transfer function 


G(s)H(s) = 


K(s + a) 
s(s + b)(s + c) 


Figure 5.12 shows vectors from open-loop poles and zeros to a trial point Sj . From 
Figure 5.12 and equation (5.57), for .sj to lie on a locus, then 


(0, +02 + 03) -Wi)= 180° 


(5.58) 


The magnitude criterion 

If a point si lies on a locus, then the value of the open-loop gain constant K at that 
point may be evaluated by using the magnitude criterion. 

Equation (5.56) can be expressed as 



(5.59) 


(5.60) 


Equation (5.60) may be written as 

Product of pole vector magnitudes 
Product of zero vector magnitudes 


(5.61) 
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Fig. 5.13 Application of the magnitude criterion. 


For Example 5.7, if s\ lies on a locus, then the pole and zero magnitudes are shown in 
Figure 5.13. From Figure 5.13 and equation (5.61), the value of the open-loop gain 
constant K at position ,vi is 


K = 


Mblkl 

M 


(5.62) 


If there are no open-loop zeros in the transfer function, then the denominator of 
equation (5.62) is unity. 


5.3.5 Root locus construction rules 

1. Starting points ( K = 0): The root loci start at the open-loop poles. 

2. Termination points (K = oo): The root loci terminate at the open-loop zeros when 
they exist, otherwise at infinity. 

3. Number of distinct root loci: This is equal to the order of the characteristic equation. 

4. Symmetry of root loci'. The root loci are symmetrical about the real axis. 

5. Root locus asymptotes'. For large values of k the root loci are asymptotic to 
straight lines, with angles given by 

p _ (l+2fr) 

(n — m) 

where 

k = 0, 1, ...(« — m — 1) 
n = no. of finite open-loop poles 
m = no. of finite open-loop zeros 
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6. Asymptote intersection : The asymptotes intersect the real axis at a point given by 


£ open-loop poles — £ open-loop zeros 
d ( n — m) 

7. Root locus locations on real axis : A point on the real axis is part of the loci if the sum 
of the number of open-loop poles and zeros to the right of the point concerned is odd. 

8. Breakaway points : The points at which a locus breaks away from the real axis can 
be calculated using one of two methods: 

(a) Find the roots of the equation 


d K 
d.s 


= 0 


S=CFb 


where K has been made the subject of the characteristic equation i.e. K = . . . 
(b) Solving the relationship 


E 

i 


i 

(Ob + \Pi\) 


E 

i 


i 

(o- b + M) 


where \p\ and |r,j are the absolute values of open-loop poles and zeros and 
<Tb is the breakaway point. 

9. Imaginary axis crossover: The location on the imaginary axis of the loci (mar- 
ginal stability) can be calculated using either: 


(a) The Routh-FLurwitz stability criterion. 

(b) Replacing by jco in the characteristic equation (since a = 0 on the imagin- 
ary axis). 

10. Angles of departure and arrived: Computed using the angle criterion, by position- 
ing a trial point at a complex open-loop pole (departure) or zero (arrival). 

1 1 . Determination of points on root loci: Exact points on root loci are found using the 
angle criterion. 

12. Determination of K on root loci: The value of K on root loci is found using the 
magnitude criterion. 


Example 5.8 (See also Appendix 1 , examp58.m and examp58a.m) 

A control system has the following open-loop transfer function 

G(s)H(s) = K 

s(s + 2)(^ + 5) 

(a) Sketch the root locus diagram by obtaining asymptotes, breakaway point and 
imaginary axis crossover point. What is the value of K for marginal stability? 

(b) Locate a point on the locus that corresponds to a closed-loop damping ratio of 
0.5. What is the value of K for this condition? What are the roots of the 
characteristic equation (closed-loop poles) for this value of KI 
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Solution 

Part (a) 


Open loop poles: s = 0, — 2, -5 n = 3 

Open-loop zeros: none m = 0 

Asymptote angles (Rule 5 ) 


« = *-<* 

(5.63) 

02 = ^^=7T= 180°, k= 1 

(5.64) 

fl 4 - 4)7t 57t 

6»3 = 3 0 = = 300°( 60°), k = 2, i.e. n m 1 

(5.65) 

Asymptote intersection ( Rule 6 ) 


{(0) + (-2) + (-5)} - 0 

CTa 3-0 

(5.66) 

cr a = -2.33 

(5.67) 

Characteristic equation : From equation (5.24) 


1 + * =0 
s(s + 2)(s+5) 

(5.68) 

or 


5(5 + 2)(s + 5) + K = 0 


giving 


s 3 + Is 2 + 10s + K = 0 

(5.69) 

Breakaway points ( Rule 8 ) 


Method (a): Re-arrange the characteristic equation (5.69) to make K the subject 

K=~s i - Is 2 - 10s 

(5.70) 

^= -3s 2 - 14s- 10 = 0 
as 

(5.71) 

Multiplying through by -1 


3s 2 + 14s 4- 10 = 0 

(5.72) 

— 14± V14 2 - 120 

Si, S 2 = CT b = , 

6 


cr b = -3.79, -0.884 

(5.73) 
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Method (b) 


(7b CTb + 2 (7 b + 5 

Multiplying through by, 

(7 b ((7 b + 2)((7 b + 5) 

((7 b + 2)(<r b + 5) + (7 b ((7b + 5) + cr b ((7b + 2) = 0 
(tJ + 7(7 b + 10 + (7^ + 5a b + (7^ + 2(7 b = 0 
3 crj + 14cr b +10 = 0 

cr b = -3.79, - 0.884 


(5.74) 


(5.75) 


(5.76) 


Note that equations (5.72) and (5.75) are identical, and therefore give the same roots. 
The first root, —3.79 lies at a point where there are an even number of open-loop poles to 
the right, and therefore is not valid. The second root, —0.884 has odd open-loop poles to 
the right, and is valid. In general, method (a) requires less computation than method (b). 

Imaginary axis crossover ( Rule 9 ) 

Method (a) (Routh-Hurwitz) 

s° K 

s 1 (70 - K)P 

s 1 7 K 

s 3 1 10 


From Routh’s array, marginal stability occurs at K = 70. 

Method (b): Substitute s = \oj into characteristic equation. From characteristic 
equation (5.69) 

(j+) 3 + 7(jw) 2 + 10(jw) + = 0 

- )u? - lur + lOjw + K = 0 (5.77) 

Equating imaginary parts gives 

— w 3 + 10 uj = 0 
w 2 = 10 

w = ±3.16 rad/s (5.78) 

Equating real parts gives 

-7ur + K = 0 

8; 7C = 7o> 2 = 70 (5.79) 

Note that method (b) provides both the crossover value (i.e. the frequency of 
oscillation at marginal stability) and the open-loop gain constant. 
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Fig. 5.14 Sketch of root-locus diagram for Example 5.8. 


The root locus diagram is shown in Figure 5.14. 

Part (b) From equation (5.52), line of constant damping ratio is 

13 = cos” 1 (£) = cos” '(0.5) = 60° (5.80) 

This line is plotted on Figure 5.14 and trial points along it tested using the angle 
criterion, i.e. 

6 \ + T $3 = 180° 

At s = —0.7 + jl-25 (5.81) 

120 + 44+ 16= 180° (5.82) 

FLence point lies on the locus. 

Value of open-loop gain constant K: Applying the magnitude criterion to the above 
point 

K= \a\\b\\c\ 

= 1.4 x 1.8 x 4.5 = 11.35 


(5.83) 
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x+5 

\UJ 

x+2 


«— * 

s, -5 -2 

(7 


Fig. 5.15 Determination of real closed-loop pole. 


Closed-loop poles (For K = 11.35): Since the closed-loop system is third-order, there 
are three closed-loop poles. Two of them are given in equation (5.81). The third lies 
on the real locus that extends from —5 to — oo. Its value is calculated using the 
magnitude criterion as shown in Figure 5.15. 

From Figure 5.15 


x(x + 2)(x + 5) = 11.35 (5.84) 

Substituting x = 0.73 (i.e. .s'i = —5.73) in equation (5.84) provides a solution. Hence 
the closed-loop poles for K = 11.35 are 

s = — 5.73, — 0.7 i jl.25 (5.85) 

Example 5.9 (See also Appendix 1, examp59.m) 

The open-loop transfer function for a control system is 

= ,(^+4, + 13) 

Find the asymptotes and angles of departure and hence sketch the root locus 
diagram. Locate a point on the complex locus that corresponds to a damping ratio 
of 0.25 and hence find 

(a) the value of K at this point 

(b) the value of K for marginal stability 

Solution 

Open-loop poles: s = 0, 


-4± ^16— 52 
2 


—2 ± j3 n = 3 


Open-loop zeros: None m = 0 
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Asymptote angles (Rule 5 ) 


0, = (1 + < *? 1r = ) = 60°, * = 0 

3-0 3 

(5.86) 

(1 + 2)7T 

9-> = — — = 7 r = 180 , k = 1 

3-0 

(5.87) 

d 3 = (1+4)7r = 57r = 300°, k= 2, n m 1 

3 3-0 3 

(5.88) 

Asymptote intersection ( Rule 6 ) 


{(0) + (—2 + j3) + (—2 — j3)} — 0 
a a = 3 

(5.89) 

fj a = -1.333 

(5.90) 

Characteristic equation 


5 3 + 4.? 2 + 13^ + ii: = 0 

(5.91) 


Breakaway points : None, due to complex open-loop poles. 

Imaginary axis crossover (Rule 9) 

Method (b) 

(jw) 3 + 4(jw) 2 + 13jw + ^ = 0 
or 

-jw 3 -4uj 2 + 1 3jw + K = 0 (5.92) 

Equating imaginary parts 

— lo 3 + 13cu = 0 
to 2 = 13 

u/ =±3.6 rad/s (5.93) 

Equating real parts 

~4u 2 + K= 0 

K = 52 (5.94) 

Angle of departure (Rule 10): If angle of departure is 9 d , then from Figure 5.16 

0 a + d b + 0 d = 180° 
d d = 18O-d a -0 b 

6 d = 180 - 123 - 90 = -33° (5.95) 

Locate point that corresponds to ( = 0.25. From equation (5.52) 


/3 = cos~' (0.25) = 75.5' 


(5.96) 
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Fig. 5.16 Root locus diagram for Example 5.9. 


Plot line of constant damping ratio on Figure 5.16 and test trial points along it using 
angle criterion. 

At 5 = -0.8+j2.9 

104.5 + 79.5 -4 = 180° 


Flence point lies on locus. 
Applying magnitude criterion 


K = 3.0 x 6.0 x 1.25 = 22.5 


(5.97) 


5.4 Design in the s-plane 

The root locus method provides a very powerful tool for control system design. The 
objective is to shape the loci so that closed-loop poles can be placed in the 5-plane at 
positions that produce a transient response that meets a given performance specifica- 
tion. It should be noted that a root locus diagram does not provide information 
relating to steady-state response, so that steady-state errors may go undetected, 
unless checked by other means, i.e. time response. 
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Table 5.2 Compensator characteristics 


Compensator 

Characteristics 

PD 

One additional zero 

PI 

One additional zero 


One additional pole at origin 

PID 

Two additional zeros 


One additional pole at origin 


5.4.1 Compensator design 

A compensator, or controller, placed in the forward path of a control system will 
modify the shape of the loci if it contains additional poles and zeros. Characteristics 
of conventional compensators are given in Table 5.2. 

In compensator design, hand calculation is cumbersome, and a suitable computer 
package, such as MATLAB is generally used. 

Case Study 

Example 5.10 (See also Appendix 1, exampS 10. m ) 

A control system has the open-loop transfer function given in Example 5.8, i.e. 

G(s)H(s)= ' K= 1 

s(s + 2)(s + 5) 

A PD compensator of the form 

G(s) = K\ (.s' + a) (5.98) 

is to be introduced in the forward path to achieve a performance specification 

Overshoot less than 5% 

Settling time (±2%) less than 2 seconds 

Determine the values of K\ and a to meet the specification. 

Original controller 

The original controller may be considered to be a proportional controller of gain K and the 
root locus diagram is shown in Figure 5.14. The selected value of K = 11.35 is for a 
damping ratio of 0.5 which has an overshoot of 16.3% in the time domain and is not 
acceptable. With a damping ratio of 0.7 the overshoot is 4.6% whichis within specification. 
This corresponds to a controller gain of 7.13. The resulting time response for the original 
system (K= 1 1.35) is shown in Figure 5.20 where the settling time can be seen to be 5.4 
seconds, which is outside of the specification. This also applies to the condition K= 7.13. 

PD compensator design 

With the PD compensator of the form given in equation (5.98), the control problem, 
with reference, to Figure 5.14, is where to place the zero a on the real axis. Potential 
locations include: 

(i) Between the poles s = 0, — 2, i.e. at s = — 1 

(ii) At s = — 2 (pole/zero cancellation) 

(iii) Between the poles s = —2, —5, i.e at s = — 3 
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Fig. 5.17 Root locus diagram for compensator K-\ (s + 1 ). 


Option 1 (zero positioned at s = —1): The cascaded compensator and plant transfer 
function become 


G{s)H(s) 


K\(s + 1 ) 
s{s + 2)(s + 5) 


(5.99) 


The root locus diagram is shown in Figure 5.17. 

It can be seen in Figure 5.17 that the pole at the origin and the zero at s = — 1 
dominate the response. With the complex loci, ( = 0.7 gives K\ a value of 15. 
However, this value of K\ occurs at —0.74 on the dominant real locus. The time 
response shown in Figure 5.20 shows the dominant first-order response with the 
oscillatory second-order response superimposed. The settling time is 3.9 seconds, 
which is outside of the specification. 

Option 2\ (zero positioned at s = —2): The cascaded compensator and plant transfer 
function is 


G(s)H(s) 


K\(s + 2) 
s(s + 2 )(s + 5) 


(5.100) 


The root locus diagram is shown in Figure 5.18. The pole/zero cancellation may be 
considered as a locus that starts at s = — 2 and finishes at s = —2, i.e. a point on 
the diagram. The remaining loci breakaway at s = —2.49 and look similar to the 
second-order system shown in Figure 5.9. The compensator gain K\ that corresponds 
to £ = 0.7 is 12.8. The resulting time response is shown in Figure 5.20 and has an 
overshoot of 4.1% and a settling time of 1.7 seconds, which is within specification. 
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Fig. 5.18 Root locus diagram for compensator Ky (s + 2). 


Option 3: (zero positioned at s = —3): The cascaded compensator and plant transfer 
function is 


G(s)H(s) 


Kyis + 3) 
s(s + 2)(s + 5) 


(5.101) 


The root locus diagram is shown in Figure 5.19. In this case the real locus occurs 
between s = — 5 and —3 and the complex dominant loci breakaway at cry, = —1.15. 
Since these loci are further to the right than the previous option, the transient 
response will be slower. The compensator gain that corresponds to ( = 0.7 is 
K\ = 5.3. The resulting time response is shown in Figure 5.20, where the overshoot 
is 5.3% and the settling time is 3.1 seconds. 

Summary: Of the three compensators considered, only option 2 met the performance 
specification. The recommended compensator is therefore 

G(s) = 12.8(s + 2) (5.102) 


Case study 

Example 5.11 (See also Appendix 1, examp 5 1 1 .m) 

A ship roll stabilization system is shown in Figure 5.21. The system parameters are 
Fin time constant 7} = 1.0 seconds 
Ship roll natural frequency = 1.4 14 rad/s 
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Fig. 5.19 Root locus diagram for compensator K-\ (s + 3). 



0 1 2 3 4 5 6 

Time(s) 

Fig. 5.20 Time response for the three options considered. 
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Stabilization Ship Roll 

Fin Dynamics 



Fig. 5.21 Ship roll stabilization system. 


Ship roll damping ratio £ = 0.248 
Ship steady-state gain K s = 0.5 

Performance specification 

Without stabilization, the step response of the roll dynamics produces a 45% over- 
shoot and a settling time of 10 seconds. The stabilization control system is required to 
provide a step response with an overshoot of less than 25%, a settling time of less 
than 2 seconds, and zero steady-state error. 

(a) Proportional control : With a proportional gain K \ , the open-loop transfer 
function is 


G(s)IKs) = 


KxK s ui 


Inserting values 


where 


G(s)II(s) = 


(1 + T[s)(s 2 + 2 £uj b s + wj) 
K 


(s + l)0 2 + 0.7s + 2) 


K = K l K s uf n 

Open-loop poles: s = — 1, — 0.35 ± j 1.37 n = 3 
Open-loop zeros: None m = 0 

Asymptote angles ( Rule 5 ) 


(5.103) 

(5.104) 

(5.105) 



k = 0 

(5.106) 

fc = ll 3 + T = ” ,wr 

, k = 1 

(5.107) 

0 3 = + ^ = 5?r = 300° 

3-0 3 

, k = 2 

(5.108) 

Asymptote intersection ( Rule 6 ) 



{(— 1) + (—0.35 + jl.37) + (— 

0.35 -jl.37)} -0 

(5.109) 

aa 3-0 


cr a = -0.57 


(5.110) 
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Characteristic equation 


giving 


1 + (s + 1)(5 2 + 0.7s + 2) ° 

5 3 + 1.7s 2 + 2.7s + (2 + K) = 0 


Breakaway points: None 

Imaginary axis crossover ( Rule 9 ) 

From characteristic equation (5.112) 

O) 3 + 1.7( juj) 2 + 2.7(jtu) + (2 + K) = 0 
-jw 3 - 1.7 J- + 2.7jw + (2 + K) = 0 


(5.111) 

(5.112) 


Equating imaginary parts 

— w 3 + 2.7u> = 0 
w 2 = 2.7 


w = ±1.643 rad/s (5.113) 

Equating real parts 

-\.7u 2 + (2 + K) = 0 

K= 1.7w 2 -2 = 2.59 (5.114) 


The root locus diagram is shown in Figure 5.22. It can be seen that proportional 
control is not appropriate since as the controller gain K\ is increased the complex loci 
head towards the imaginary axis, making the response even more oscillatory than the 
open-loop response, until at K = 2.59 ( K\ = 2.59) the system becomes unstable. 
Also, since no pure integrator is present in the control loop, there will be significant 
steady-state errors. 


(b) RID control: In order to achieve an acceptable response, the complex loci need 
to be attracted into the left-hand-side of the 5-plane. This might be achieved by 
placing a pair of complex zeros to the left of the open-loop poles. In addition, a pure 
integrator needs to be introduced. This points to a PID controller of the form 


G(s) = 


K\ {s 2 + bs + c) 


(5.115) 


putting b = 4 and c = 8 gives a pair of complex zeros 

s = — 2 ± j2 

The open-loop transfer function now becomes 

K(s 2 + 4^ + 8) 


G(s)H(s) = 


5 ( 5 + l)(5 2 + 0.75 + 2) 


(5.116) 


The root locus diagram is shown in Figure 5.23. The control strategy however, 
has not worked. The pure integrator and the open-loop pole 5 = —1 produce a 



Imaginary Axis ip Imaginary Axis 
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K = 2.59 

g (s) - 2 k 

(s+1)(s + 0.7 s+ 2) 
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1 1 1 1 1 1 
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5.22 Proportional control, ship roll stabilization system. 



Fig. 5.23 PID control, ship roll stabilization system. 
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Real Axis 


Fig. 5.24 PIDD control, ship roll stabilization system. 


breakaway point at s = —0.6. This in turn creates a second pair of complex loci that 
terminate at the new open-loop zeros, leaving the original complex loci to crossover 
the imaginary axis as before. 


(c) PIDD control : If an additional open-loop zero is placed on the real axis, to the 
left of the open-loop pole s = — 1 , a further breakaway point will occur to the left of 
the new zero. This should have the effect of bringing one pair of complex loci back to 
the real axis, whilst allowing the original complex loci to terminate at the complex 
open-loop zeros. If a new real zero is placed at s = —2, the open-loop transfer 
function becomes 


G(s)H(s) 


K(s + 2 )0 2 + 4.v + 8) 
4 s + 1 )(.? 2 + 0 . 7.5 + 2 ) 


(5.117) 


The resulting root-locus diagram is shown in Figure 5.24. 

The control strategy for the root-locus diagram shown in Figure 5.24 is called 
PIDD, because of the additional open-loop zero. The system is unstable between 
K = 0.17 and K = 1.06, but exhibits good transient response at K = 10.2 on both 
complex loci. 

Figure 5.25 shows the step response for (a) the hull roll action without a stabilizer 
system, and (b) the hull roll action with a controller/compensator with a control law 

, 10 . 2 (s + 2)(4 + 4 . s + 8 ) 


(5.118) 
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Time(s) 


Fig. 5.25 Ship hull step response with and without stabilizers system. 


System performance 

(i) Without stabilizer system 

Rise time (95%) 1.3 seconds 

Percentage Overshoot 45% 

Settling time (±2%) 10.0 seconds 

(ii) With stabilizer system 

Rise time (95%) 0.14 seconds 

Percentage overshoot 22.8% 

Settling time (±2%) 1.4 seconds 

With the stabilizer system, the step response meets the performance specification. 


5.5 Further problems 


Example 5.12 

Use the Routh-Hurwitz criterion to determine the number of roots with positive real 
parts in the following characteristic equations 

(a) s 4 + 3s 3 + 6s 2 + 2s + 5 = 0 Ans: two 

(b) s 5 + 2s 4 + 3s 3 + As 2 + 2s + 1 = 0 Ans: none 
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Example 5.13 

Find the value of the open-loop gain constant K to make the control system, whose 
open-loop transfer function is given below, just unstable. 


G(s)H(s) 


K 

s{s + l)(.s + 8) 


Ans: 72 


Example 5.14 

A feedback control system has the following open-loop transfer function 

G(s)H(s) = * 

s(s + 1 If? + 5) 

(a) Sketch the root locus by obtaining asymptotes, breakaway point and imaginary 
axis cross-over point. 

(b) A compensating element having a transfer function G(s) = (s + 2) is now 
included in the open-loop transfer function. If the breakaway point is —0.56, 
sketch the new root locus. Comment on stability of the system with, and without 
the compensator. 

(c) Demonstrate that for the compensated system the co-ordinates —2.375, 
— 1.8 ± j 4.0 lie on the curve. What is the value of K for these points? 


Solution 

(a) a a = —2, ah — —0.47, u = ±j2. 24 rad/s 

(b) With compensator, system stable for all K 

(c) K = 23 

Example 5.15 

A feedback control system employing proportional control has the following open- 
loop transfer function 

G(s)H(s) = f .. 

(5 + i)(5 2 + 5+1) 

(a) Using asymptotes, sketch the root locus diagram for the closed-loop system and 
find 

(i) the angles of departure from any complex open-loop poles, 

(ii) the frequency of transient oscillation at the onset of instability, 

(iii) the value of K to give the dominant closed-loop poles a damping ratio £ of 
0.3 

(b) To improve the steady-state performance the proportional controller is replaced 
by a proportional plus integral controller. The forward-path transfer function 
now becomes 


G(s) 


K(s + 2) 

s(s+ l)(5 2 +5+ 1) 



Demonstrate that 

(i) the two breakaway points occur at 
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ext,, = —0.623 
crbi = —2.53 

(ii) the imaginary axis crossover occurs when K = 0.464 

Solution 

(a) (i) ±30°, (ii) 1.414 rad/s, (iii) K = 0.55 

Example 5.16 

(a) The laser guided missile shown in Figure 5.26(a) has a pitch moment of inertia of 
90kgm 2 . The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle f3. The fin positional control system has unity gain 
and possesses a time constant of 0.2 seconds. If all other aerodynamic effects are 
ignored, find the transfer functions of the control fins and missile (in pole-zero 
format) in the block diagram given in Figure 5.26(b). 

(b) You are to conduct a feasibility study to evaluate various forms of control 
action. Initially proportional control is to be considered. Using asymptotes only, 
construct the root locus diagram and give reasons why it would be unsuitable. 




(b) 


Fig. 5.26 Laser guided missile. 
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(c) An open-loop zero is now introduced at s = —2. Again construct the root-locus 
diagram using asymptotes and comment on the suitability of the system. 

(d) Open-loop zeros at s = — 2 and s = — 3 are now introduced. Demonstrate that at 
s = —2.45 the complex loci join the real axis prior to terminating at the open- 
loop zeros. Show also that a trial point on the locus exists when jw = 1 .45 and the 
damping ratio £ = 0.7. Sketch the root locus diagram and evaluate the controller 
gain that corresponds to £ = 0.7. 

Solution 

(a) G 2 (s) = 5/(s + 5) G 3 (s) = 4/s 2 

(b) System unstable for all K 

(c) System stable for all K 

(d) Controller gain = 0.24 



6 


Classical design in the 
frequency domain 


6.1 Frequency domain analysis 

Control system design in the frequency domain can be undertaken using a purely 
theoretical approach, or alternatively, using measurements taken from the compon- 
ents in the control loop. The technique allows transfer functions of both the system 
elements and the complete system to be estimated, and a suitable controller/compen- 
sator to be designed. 

Frequency domain analysis is concerned with the calculation or measurement of 
the steady-state system output when responding to a constant amplitude, variable 
frequency sinusoidal input. Steady-state errors, in terms of amplitude and phase 
relate directly to the dynamic characteristics, i.e. the transfer function, of the system. 

Consider a harmonic input 


9[{t) = A \ sin tot 

(6.1) 

This can be expressed in complex exponential form 


m = A ie ^ 

(6.2) 

The steady-state response of a linear system will be 


9 0 {t) = Ai sinftui — <f>) 

(6.3) 

or 


9 0 (t) = A 2 e i(u *-® 

(6.4) 


where ^ is the phase relationship between the input and output sinewaves as shown in 
Figure 6.1. The amplitude ratio A 2 /A 1 is called the modulus and given the symbol |G|. 
Thus 


Ai 
A 1 


\G\ 


or 


(6.5) 


a 2 = a 1 \g\ 


( 6 . 6 ) 
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Fig. 6.1 Steady-state input and output sinusoidal response. 



Fig. 6.2 Harmonic response diagram. 

Substituting equation (6.6) into (6.3) 

0 o (t) = 

= A i |G|e j “ ! e”^ 


(6.7) 
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0o(t) = (^ie jw ')(|G|e-^) 

= 9 i (t)\G\eT«’ (6.8) 

Since |G| and <j> are functions of ui, then equation (6.8) may be written 

^(w) = |G(w)|e-j«"> (6.9) 

Vi 

For a given value of u>, equation (6.9) represents a point in complex space P(uj). When 
u> is varied from zero to infinity, a locus will be generated in the complex space. This 
locus, shown in Figure 6.2, is in effect a polar plot, and is sometimes called a 
harmonic response diagram. An important feature of such a diagram is that its shape 
is uniquely related to the dynamic characteristics of the system. 


6.2 The complex frequency approach 


Relationship between s and jw. From equation (6.2) 

dO 

— = jw04ie JW 0 =ju£i(t) 


Taking Laplace transforms 


s0i(s) = ja;0i(5) 


(6.10) 


or 

•s = jw (6.11) 

Hence, for a sinusoidal input, the steady-state system response may be calculated by 
substituting s = jw into the transfer function and using the laws of complex algebra 
to calculate the modulus and phase angle. 


6.2.1 Frequency response characteristics of first-order systems 


Front equation (3.23) 


0i 


(s) 


G(s) 


K 

1 + Ts 


( 6 . 12 ) 


For a sinusoidal input, substitute equation (6.11) into (6.12). 


^O) = G(ju) 


K 

1 +j wf 


(6.13) 


Rationalize, by multiplying numerator and denominator of equation (6.13) by the 
conjugate of (6.13), i.e. 


G( jw) 


^(1 ~j coT) 

(1 +jwT)(l -}wT) 


m -j uT) 

1 +io 2 T 2 


(6.14) 
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Equation (6.14) is a complex quantity of the form a + ]b where 


Real part a = =—7 

F 1 +u 2 T 2 

(6.15) 

- KloT 

Imaginary part b - lrrl 

1 + uj-T- 

(6.16) 


Hence equation (6.14) can be plotted in the complex space (Argand Diagram) to 
produce a harmonic response diagram as shown in Figure 6.3. 

In Figure 6.3 it is convenient to use polar co-ordinates, as they are the modulus and 
phase angle as depicted in Figure 6.2. From Figure 6.3, the polar co-ordinates are 

|G(jw)| = 


which simplifies to give 


Comparing equations (6.14) and (6.18), providing there are no zeros in the transfer 
function, it is generally true to say 

|G(jw)| = . = (6.19) 

A/Denominator of C(jo;) 


\J a 1 + b 1 


K \ 2 ( -KluT n 2 


+ 


1 + u 2 T 2 \\+u 2 T 2 


(6.17) 


|G(»| = 


K 


J 1 _ 1 _ ,., 2 t 2 


(6.18) 



Fig. 6.3 A point in complex space for a first-order system. 
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(b) Rectangular Plot (Frequency Response) 


Fig. 6.4 Graphical display of frequency domain data for a first-order system. 


Table 6.1 Modulus and phase for a first-order system 


ui (rad/s) |G(ju)| ZG(ja/) (degrees) 


OK -0 

l/T K/y/ 2 -45 

oo 0 —90 


The argument, or phase angle is 


ZG(jtu) = tan 

\a 


= tan 


f -KujT 

-i I t+^r ; 


s-r- 


( 6 . 20 ) 


which gives 


= tan 1 (—dT) 


( 6 . 21 ) 
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Using equations (6.18) and (6.21), values for the modulus and phase angle may be 
calculated as shown in Table 6.1. The results in Table 6.1 may be represented as a 
Polar Plot, Figure 6.4(a) or as a rectangular plot, Figures 6.4(b) and (c). Since the 
rectangular plots show the system response as a function of frequency, they are 
usually referred to as frequency response diagrams. 


6.2.2 Frequency response characteristics of second-order 
systems 

From equation (3.42) the standard form of transfer function for a second-order 
system is 

K 


G ^ _L c.2 , K 


Substituting s = jw 




s 2 + 4^ + 1 


G( }J) = 


K 

(j^) 2 + fr(j^) + 1 


or 


G(jui) = 


K 


Rationalizing gives 


K 


1 - fa) - } ~j{ 2 c fa)} 


G(juj) = 


Using equations (6.17) and (6.19), the modulus is 

ICWI = , K 


.> - (*)') 
And from equation (6.20), the argument is 


/G(jw) = tan 


-l 


i~ 2 < 

(V 

>1 

H 

J 

3 J 


( 6 . 22 ) 


(6.23) 


(6.24) 


(6.25) 


(6.26) 


(6.27) 


Table 6.2 Modulus and phase for a second-order system 


ui (rad/s) 

|G(jw)| 

ZG( ju) (degrees) 

0 

K 

-0 


K/2( 

-90 

(X) 

0 

-180 
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Im 



Fig. 6.5 Polar plot of a second-order system. 

From equations (6.26) and (6.27) the modulus and phase may be calculated as shown 
in Table 6.2. The results in Table 6.2 are a function of ( and may be represented as a 
Polar Plot, Figure 6.5, or by the frequency response diagrams given in Figure 6.6. 


6.3 The Bode diagram 

The Bode diagram is a logarithmic version of the frequency response diagrams 
illustrated in Figures 6.4(b) and (c), and also Figure 6.6, and consists of 

(i) a log modus-log frequency plot 

(ii) a linear phase-log frequency plot. 

The technique uses asymptotes to quickly construct frequency response diagrams by 
hand. The construction of diagrams for high-order systems is achieved by simple 
graphical addition of the individual diagrams of the separate elements in the system. 
The modulus is plotted on a linear y-axis scale in deciBels, where 

|G(»|dB=201og 10 |G(»| (6.28) 


The frequency is plotted on a logarithmic x-axis scale. 
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(a) Modulus 



(b) Phase 

Fig. 6.6 Frequency response diagrams for a second-order system. 

6.3.1 Summation of system elements on a Bode diagram 

Consider two elements in cascade as shown in Figure 6.7. 

Gi(jw) = |Gi(jw)|e^ (6.29) 

Gztiw) = |G 2 (jcu)|e^ (6.30) 
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RQlo) 


> Gi(jw) 


* G 2 (M 


> C(jw) 


Fig. 6.7 Summation of two elements in cascade. 


c 

-(jw) = Gi(jw)G 2 (jw) 

= |G!(ja;)||G 2 (ja;)|e^' + ^ 


(6.31) 


Hence 


^(jw) = |Gi(jw)||G2(jw)| 


or 


^(jw) d B = 20 log 10 | G ! ( jccJ>| + 20 log 10 |G 2 (jw)| 


(6.32) 


and 



(6.33) 


In general, the complete system frequency response is obtained by summation of the 
log modulus of the system elements, and also summation of the phase of the system 
elements. 

6.3.2 Asymptotic approximation on Bode diagrams 

(a) First-order lag systems 

These are conventional first-order systems where the phase of the output lags behind 
the phase of the input. 

(i) Log modulus plot : This consists of a low-frequency asymptote and a high- 
frequency asymptote, which are obtained from equation (6.18). 

Low frequency (LF) asymptote : When u> — > 0, |G(ju;)| — > K. Hence the LF 
asymptote is a horizontal line at K dB. 

High frequency (HF) asymptote : When w \/T, equation (6.18) approximates 
to 



(6.34) 


As can be seen from equation (6.34), each time the frequency doubles (an increase of 
one octave) the modulus halves, or falls by 6dB. Or alternatively, each time the 
frequency increases by a factor of 10 (decade), the modulus falls by 10, or 20 dB. 
Hence the HF asymptote for a first-order system has a slope which can be expressed 
as — 6dB per octave, or — 20 dB per decade. 
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From equation (6.34), when oj = \/T, the HF asymptote has a value of K. Flence 
the asymptotes intersect at w= l/T rad/s. Also at this frequency, from equation 
(6.18) the exact modulus has a value 

Since l/y/2 is —3 dB, the exact modulus passes 3 dB below the asymptote intersection 
at l/T rad/s. The asymptotic construction of the log modulus Bode plot for a first- 
order system is shown in Figure 6.8. 



Fig. 6.8 Bode modulus construction for a first-order system. 



Fig. 6.9 Bode phase construction for a first-order system. 
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(ii) Phase plot. This has three asymptotes 

• A LF horizontal asymptote at 0° 

• A F1F horizontal asymptote at —90° 

• A Mid-Frequency (MF) asymptote that intersects the LF asymptote at 1/103" 
and the HF asymptote at 10/7" (i.e. a decade either side of 1/3"). 

The Bode phase plot for a first-order system is given in Figure 6.9. 

(b) First-order lead systems 

These are first-order systems where the phase of the output (in steady-state) leads the 
phase of the input. The transfer function of a first-order lead system is 

G(s) = K( 1 + Ts) (6.35) 

and 

|G(»| = Ky/\ +co 2 T 2 (6.36) 

ZG(jcu) = tai \-\toT) (6.37) 

The Bode diagram, given in Figure 6.10, is the mirror image, about the frequency 
axis, of the first-order lag system. Note that the transfer function given in equation 
(6.35) is also that of a PD controller. 


(c) Second-order systems 

(i) Log modulus plot 

LF asymptote : A horizontal line at K dB 

HF asymptote'. When u> w n , equation (6.26) approximates to 

|G(jw)| = K (6.38) 

I iL 


From equation (6.38), an octave increase in frequency will reduce the modulus by 
a quarter, or — 12 dB and a decade frequency increase will reduce the modulus 
by a factor of 100, or — 40dB. Hence the HF asymptote for a second-order system 
has a slope of — 12dB/octave or — 40dB/decade. The LF and HF asymptotes inter- 
sect at u> = u) n . Also at cu n , the exact value of modulus from equation (6.26) is 

\G(ju>)\ = 


The value of the modulus relative to the LF asymptote is 



20 log 10 



|G(ja>)|dB = 201og 10 


(6.39) 
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|G(HI 

dB 




Fig. 6.10 Bode gain and phase for a first-order lead system. 

Hence 

C = 0.25, Relative modulus = +6dB 
( = 0.5, Relative modulus = OdB 
£ = 1.0, Relative modulus = — 6dB 

(ii) Phase plot : This has two asymptotes: 

• A LF horizontal asymptote at 0° 

• A HF horizontal asymptote at — 1 80° . 

The phase curve passes through —90° at to = w n . Its shape depends upon £ and 
obtained from the standard curves given in Figure 6.11. 
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(b) Phase 


Fig. 6.11 Bode gain and phase for a second-order system. 
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(d) A pure integrator 

Consider a pure integrator of the form 


G(s) = 


K 

s 


now 


G(jw) 


K 

0+jw 


Rationalizing 


G( }oj) = 


K( 0-jw) 


(6.40) 


(6.41) 


From equation (6.17) 

|G(jw)| = Jo + ^ - = — (6.42) 

V ur to 

and from equation (6.20) 

ZG(jtu) = tan -1 ^ Ku/uj ^ _ tan -i = _90° (6.43) 

It can be seen from equation (6.42) that the modulus will halve in value each time the 
frequency is doubled, i.e. it has a slope of — 6dB/octave ( — 20dB/decade) over the 
complete frequency range. 

Note that 


|G(ju;)| = K dB when oj = 1 
|G(ju;)| = 1 = OdB when w = K 

The Bode diagram for a pure integrator is shown in Figure 6.12. 



Fig. 6.12 Bode diagram for a pure integrator. 
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Example 6.1 (See also Appendix 1, examp61.ni) 

Construct, using asymptotes, the Bode diagram for 

G(s) = — (6.44) 
1 + 0.5s 

Low Frequency asymptote is a horizontal line at A'dB, 

i.e. +6dB 

Asymptote intersection (break frequency) occurs at 1/7) i.e. 2 rad/s. The Bode 
diagram is shown in Figure 6.13. 



(a) Bode Gain 


u> (rad/s) 



(b) Bode Phase 


ui (rad/s) 


Fig. 6.13 Bode diagram for G(s) = 2/1 + 0.5s. 
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Example 6.2 (See also Appendix 1 , examp62.m ) 
Draw the Bode diagram for 


G(s) 


4 

0.25s 2 + 0.25 + 1 


(6.45) 



(a) Bode Gain 


u > (rad/s) 



(b) Bode Phase 


uj (rad/s) 


Fig. 6.14 Bode diagram for a second-order system, K = 4, u n = 2, ( = 0.2. 
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Comparing equation (6.45) with the standard form given in (6.22) 

-^=0.25 
i.e. w n = 2rad/s 



Wn 


i.e. C = 0.2 

Low Frequency asymptote is a horizontal line at AdB 

i.e. 20 log| 0 (4) = +12 dB 

The log modulus relative to the LF asymptote at u> = w n is given by equation (6.39) 

|G(jcu)L n =201og 10 ^ =8dB 

(Hence the absolute log modulus at to = uj n is 20 dB). The Bode diagram is given by 
Figure 6.14. Note in Figure 6.14 that the phase curve was constructed by reading the 
phase from Figure 6.11(b), an octave either side of u> n . 


Example 6.3 

Construct, on log-linear graph paper, using asymptotes, and validate using 
MATLAB or a similar tool, the Bode diagrams for 


(a) G(s) 

(b) G(s) 

(c) G(s) 


4 

s(l + 2s) 

1 

(1 +0.5j)( 1 +4s) 

10 ( 1+0 

(1+0.20(1+50 


(d) G(s) 


100 

00.250 + 0.H+ 1) 


6.4 Stability in the frequency domain 


6.4.1 Conformal mapping and Cauchy's theorem 

In Chapter 5 the stability of linear control systems were considered in the s-plane. 
Using a process of conformal transformation or mapping, it is possible to map a 
contour from one complex plane to another. It is therefore possible to transfer 
stability information from the s-plane to another complex plane, the F(^)-plane. 
The relationship between the contours in the two complex planes is given by 
Cauchy’s theorem, which states: ‘For a given contour in the .v-plane that encircles 
P poles and Z zeros of the function F(s) in a clockwise direction, the resulting 
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(b) F(s)-plane 


Fig. 6.15 Mapping of a contour from the s-plane to the F(s)-plane. 


contour in the F(.v)-planc encircles the origin a total of N times in a clockwise 
direction’. 

Where 

N = Z — P (6.46) 


Consider a function 

= (J + Zl)(g + Z 2 ) 

(s + ^l)(s+^ 2 ) 


(6.47) 


where z \ and r 2 are zeros of F(s ) and p\ and p 2 are poles. Equation (6.47) can be 
written as 

F(s) = \F(s)\tF(s) 

The mapping of a contour from the 5-plane to the F(j)-plane is shown in Figure 6. 15. 
From Figure 6.15 


and 


\F(s)\ = 


(6.48) 


£F(s) = <t>zi + ~ 4> P i - <Pp2 (6.49) 

As 5i in Figure 6.15(a) is swept clockwise around the contour, it encircles two zeros 
and one pole. From Cauchy’s theorem given in equation (6.46), the number of 
clockwise encirclements of the origin in Figure 6.15(b) is 

N= 2-1=1 (6.50) 


6.4.2 The Nyquist stability criterion 

A frequency domain stability criterion developed by Nyquist (1932) is based upon 
Cauchy’s theorem. If the function F(s) is in fact the characteristic equation of a 
closed-loop control system, then 
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F(s) = 1 + G(s)H(s) (6.51) 

Note that the roots of the characteristic equation are the closed-loop poles, which are 
the zeros of F(s). 

In order to encircle any poles or zeros of F(s) that lie in the right-hand side of the 
s-plane, a Nyquist contour is constructed as shown in Figure 6.16. To avoid poles at 
the origin, a small semicircle of radius s, where e — * 0, is included. 

Figure 6.17(a) shows the 1 + G{s)H(s ) plane when Z — P = 2, i.e. two clockwise 
encirclements. However, if the contour is plotted in G(s)H(s ) plane as shown in 
Figure 6.17(b), then it moves one unit to the left, i.e. encircles the —1 point. 



Fig. 6.16 s-plane Nyquist contour. 



(a) 1 +G{s)H(s) plane 



(b) G(s)H(s) plane 


Fig. 6.17 Contours in the 1 + G{s)H(s) and G{s)H(s) planes. 
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The Nyquist stability criterion can be stated as: ‘A closed-loop control system is 
stable if, and only if, a contour in the G(s)H{s) plane describes a number of counter- 
clockwise encirclements of the ( — 1 , jO) point, the number of encirclements being 
equal to the number of poles of G(s)H(s ) with positive real parts’. 

Hence, because there is a net clockwise encirclement of the (—1, jO) point in Figure 
6.17(b) the system is unstable. If, however, there had been a net counter-clockwise 
encirclement, the system would have been stable, and the number of encirclements 
would have been equal to the number of poles of G(s)H(s) with positive real parts. 

For the condition P = 0, the Nyquist criterion is: ‘A closed-loop control system is 
stable if, and only if, a contour in the G(s)H{s) plane does not encircle the ( — 1 , jO) 
point when the number of poles of G(s)H(s) in the right-hand .v- plane is zero’. 

In practice, only the frequencies w = 0 to +00 are of interest and since in the 
frequency domain 5 = jca, a simplified Nyquist stability criterion, as shown in Figure 
6.18 is: ‘A closed-loop system is stable if, and only if, the locus of the G{)lo)H()uj) 
function does not enclose the ( — 1, jO) point as w is varied from zero to infinity. 
Enclosing the ( — 1 , jO) point may be interpreted as passing to the left of the point’. 
The G(jw)//(ja;) locus is referred to as the Nyquist Diagram. 

An important difference between analysis of stability in the .v-plane and stability in 
the frequency domain is that, in the former, system models in the form of transfer 
functions need to be known. In the latter, however, either models or a set of 
input-output measured open-loop frequency response data from an unknown system 
may be employed. 

Margins of stability 

The closer the open-loop frequency response locus G(]uj)H(}uj) is to the ( — 1 , jO) 
point, the nearer the closed-loop system is to instability. In practice, all control 



Fig. 6.18 Nyquist diagram showing stable and unstable contours. 
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Fig. 6.19 Gain margin (GM) and phase margin (PM) on the Nyquist diagram. 

systems possess a Margin of Stability, generally referred to as gain and phase 
margins. These are shown in Figure 6.19. 

Gain Margin (GM): The gain margin is the increase in open-loop gain required 
when the open-loop phase is —180° to make the closed-loop system just unstable. 


Nyquist diagram 


Bode diagram 


GM = 


1 


GM — 20 log 


|G(jw)tf(jw)| lg0 
1 


10 


|G(jw)i/(ju;)| 

180 


(6.52) 


(6.53) 


Phase Margin ( PM ) : The phase margin is the change in open-loop phase, required 
when the open-loop modulus is unity, (or OdB on the Bode diagram) to make the 
closed-loop system just unstable. 

Phase Margin = 180 — /G(jw)//(jw)(mod = 1) (6.54) 


1 66 Advanced control engineering 


Controller 


Plant 



Fig. 6.20 Closed-loop control system. 


Example 6.4 (See also Appendix 1, examp64.m ) 

Construct the Nyquist diagram for the control system shown in Figure 6.20 and find 
the controller gain K\ that 

(a) makes the system just unstable. (Confirm using the Routh stability criterion) 

(b) gives the system a gain margin of 2 (6dB). What is now the phase margin? 


Solution 

Open-loop transfer function 

G(s)H(s) = K 

s(s z + 2s + 4) 

where 


K = 4K< 


K 


G(s)H(s ) = 3 , . , . 

s 3 + 2s~ + 4s 

G( jw)tf(jw) = - K 


Rationalizing 


From equation (6.19) 


From equation (6.20) 


G(jw)tf(ju;) = 


(jw) + 2(jw)- + 4jtu 
K 

—2u> 2 + j(4 U! — w 3 ) 

K{-2io 2 -j(4w-u; 3 )} 
4co 4 + (4w - w 3 ) 2 


|G(j W )//(ju;)| = 


K 


ZG(jw)//(jw) = tan 


+ (4 u - w 3 ) 2 
I f — (4 LO — w 3 ) 


= tan 


—2 ur 

i ^4 — w 2 
2 u 


(6.55) 

(6.56) 


(6.57) 


(6.58) 


(6.59) 
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Table 6.3 Data for Nyquist diagram for system in Figure 6.20 


u> (rad/s) 

0.5 

1.0 

1.5 

2.0 

2.5 

3.0 

4.0 

5.0 

\G(MH(M\(K = 1) 
lG(jui)H(Ju>) (deg) 

0.515 

-105 

0.278 

-124 

0.191 

-150 

0.125 

-180 

0.073 

-204 

0.043 

-220 

0.018 

-236 

0.0085 

-245 


The Nyquist diagram is constructed, for K = 1, at frequencies either side of the 180° 
point, which, from equation (6.59) can be seen to be u = 2 rad/s. Using equations 
(6.58) and (6.59), Table 6.3 may be evaluated. 

(a) From equation (6.52) 

GM= 1/0.125 = 8 

Value of K to make system just unstable 


Vunstab = K ■ GM 
=1x8=8 


From equation (6.56) 


K\ for instability = 2 

(b) For a GM of 2, the locus must pass through the (—0.5, jO) point in Figure 6.21 . 
This can be done by multiplying all the modulus values in Table 6.3 by four and 
re-drawing Figure 6.21. Alternatively, the scales of Figure 6.21 can be multiplied 
by a factor of four (without re-drawing). Hence the unit circle is 0.25 x 4 and the 
PM can be seen to have a value of 50° when the GM is 2.0. 

Value of K to give a GM of 2 is the original K times 4, i.e. 1 x 4 = 4. From (6.56) 

K { = 1.0 

Hence, to give a GM of 2 and a PM of 50°, the controller gain must be set at 1.0. If it 
is doubled, i.e. multiplied by the GM, then the system just becomes unstable. Check 
using the Routh stability criterion: 

Characteristic equation 

1 + s(.s 2 + 2^ + 4) 

,? 3 + 2s 1 + 4s + K = 0 

Routh’s array 

s° K 

s' i(8 - K ) 
s 2 2 K 

5 3 1 4 


(6.60) 

(6.61) 


Thus when K > 8 then the system is unstable. 
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Fig. 6.21 Nyquist diagram for system in Figure 6.20. 


System type classification 

Closed-loop control systems are classified according to the number of pure integra- 
tions in the open-loop transfer function. If 


G(s)H( S ) = 


sn riL, c s+Pk) 


(6.62) 


Then n in equation (6.62) is the ‘type number’ of the system and denotes the 
product of the factors. The system ‘type’ can be observed from the starting point 
(to — > 0) of the Nyquist diagram, and the system order from the finishing point 
(w — > oo), see Figure 6.22. 


System 'type' and steady-state errors 

From the final value theorem given in equation (3.10) it is possible to define a set of 
steady-state error coefficients. 


K p = lim G(s) 

s — >0 


1. Position error coefficient 
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(a) First-order type zero system (b) Second-order type one system 



(c) Third-order type two system 

Fig. 6.22 Relationship between system type classification and the Nyquist diagram. 
For a step input, 

1 


2. Velocity error coefficient 

K w = lim .v G(s) 

s — >0 


For a ramp input, 


1 



3. Acceleration error coefficient 

K a = lim s 2 G(s ) 

.s^O 


For a parabolic input. 


^SS 


1 

Aa 


(6.63) 


(6.64) 


(6.65) 
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Table 6.4 Relationship between input function, system 
type and steady-state error 


Input function 

Steady-state error 

Type zero 

Type one 

Type two 

Step 

constant 

zero 

zero 

Ramp 

increasing 

constant 

zero 

Parabolic 

increasing 

increasing 

constant 


Table 6.4 shows the relationship between input function, system type and steady- 
state error. From Table 6.4 it might appear that it would be desirable to make most 
systems type two. It should be noted from Figure 6.22(c) that type two systems are 
unstable for all values of K, and will require some form of compensation (see 
Example 6.6). 

In general, type zero are unsatisfactory unless the open-loop gain K can be raised, 
without instability, to a sufficiently high value to make 1/(1 + K p ) acceptably small. 
Most control systems are type one, the integrator either occurring naturally, or 
deliberately included in the form of integral control action, i.e. PI or PID. 

Stability on the Bode diagram 

In general, it is more convenient to use the Bode diagram in control system design 
rather than the Nyquist diagram. This is because changes in open-loop gain do not 
affect the Bode phase diagram at all, and result in the Bode gain diagram retaining its 
shape, but just being shifted in the i-direction. 

With Example 6.4 (see also Appendix 1, examp64a.m and examp64b.m), when the 
controller gain set to K\ = 1.0, the open-loop transfer function is 

g W"W = ^ + 1 + 4 ) |6 “> 

Equation (6.66) represents a pure integrator and a second-order system of the form 

= 5 (0.25s 2 + ‘ 0 .5s + 1) |6 - 67) 

As explained in Figure 6.12 the pure integrator asymptote will pass through OdB at 
1.0 rad/s (for K= 1 in equation (6.67)) and the second-order element has an 
undamped natural frequency of 2.0 rad/s and a damping ratio of 0.5. 

Figure 6.23(a), curve (i), shows the Bode gain diagram for the transfer function 
given in equation (6.66), which has a gain margin of 6 dB (the amount the open-loop 
gain has to be increased to make the system just unstable. Figure 6.23(a), curve (ii), 
shows the effect of increasing A by a factor of two (6 dB) to make the system just 
unstable. For curve (ii) the open-loop transfer function is 

<*W> = ^ + i + 4) l“ S ) 

Figure 6.23(b) shows the Bode phase diagram which is asymptotic to —90° at low 
frequencies and —270° at high frequencies, passing through —180° at 2 rad/s. To 
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determine the phase margin, obtain the open-loop phase when the modulus is 0 dB 
(on curve (i), Figure 6.23(a), this is approximately 1.1 rad/s), and subtract the phase 
from 180° to give a PM of 50° as shown. 



10 1 10 ° 10 1 


Frequency (rad/s) 
(a) Bode Gain 



Frequency (rad/s) 
(b) Bode Phase 


Fig. 6.23 Stability on the Bode diagram. 
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6.5 Relationship between open-loop and closed-loop 
frequency response 

6.5.1 Closed-loop frequency response 

When designing a control system it is essential to 

(a) ensure that the system is stable for all operating regimes 

(b) ensure that the closed-loop performance meets the required specification. 

Time domain performance specifications are described in section 3.7 and Figure 3.21. 
Frequency domain performance specifications are given in terms of gain and phase 
margins to provide adequate stability together with information relating to the 
closed-loop frequency response. Figure 6.24 shows the closed-loop frequency 
response of a control system. The closed-loop modulus is usually defined as 


C 

5 <J " ) 


= M 


(6.69) 


Bandwidth (wb): This is the frequency at which the closed-loop modulus M has fallen 
by 3dB below its zero frequency value. (This is not true for systems that do not 
operate down to dc levels.) 

Peak modulus (M p ): This is the maximum value that the closed-loop modulus M 
rises above its zero frequency value. 

Peak frequency (w p ): This is the frequency that the peak modulus occurs. Note that 

<Up < U> B- 

Second-order system closed-loop frequency response 

Many closed-loop systems approximate to second-order systems. Equation (6.26) 
gives the general equation for modulus. If, when K is set to unity, this equation is 



Fig. 6.24 Closed-loop frequency response. 
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squared, differentiated with respect to c o 2 and equated to zero (to find a maximum), 
then 


M p = 


1 


2C\A 3 c^ 

' p = WnV / l -2C 2 


(6.70) 


(6.71) 


If, as a rule-of-thumb, M p is limited to 3dB (\/2), then from equations (6.70), (6.71) 
and Figure 6.11 


C = 0.38 

w p = 0.84a) n (6.72) 

tu B = 1 -4w n 


In general, for a unity feedback control system, the closed-loop frequency response is 
given by equation (6.73) 




G(juj) 

1 + G( jw) 


(6.73) 


Equation (6.73) can be expressed in rectangular co-ordinates as 

C XQu)+}Y(}u) 

R } l + X(jcu)+)Y(M 

Hence 


(6.74) 


C ( . X(ju)+jY(ju)\ 

R iUj) |l+X(j W )+jE(jcu)| 


(6.75) 


Equation (6.75) can be expressed as an equation of a circle of the form 


*(jw)- 


M 2 


M 2 - 1 


+ E(jtu) 2 = 


M 


M 2 - 1 


(6.76) 


i.e. 


centre 


radius ± 


- M 2 

M 2 - 1 
/ M 


,0 


(M 2 - 1 


(6.77) 


Also, from equation (6.73) 


= /(JT(jw) + E(jcu)) - /(I + X(jtu) + E(jtu)) 


(6.78) 
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Equation (6.78) can also be expressed as an equation of a circle of the form 


^A(jw) + 




1 / N 2 + 1 \ 

4 \ TV 2 / 


(6.80) 


i.e. 


centre 

radius 


-1/2, 1/2JV 

VN 2 + 1 
2N 


(6.81) 


The M and N circles can be superimposed on a Nyquist diagram (called a Hall chart) 
to directly obtain closed-loop frequency response information. 

Alternatively, the closed-loop frequency response can be obtained from a Nyquist 
diagram using the direct construction method shown in Figure 6.25. From equation 
(6.73) 


C |g(ju;)| _ |OB| 

R yi } |l + G(ju,)| | AB j 


(6.82) 


Also from equation (6.73) 

/ ^(j U/ ) = + 

= ZCOB - /OAB 


(6.83) 



Fig. 6.25 Closed-loop frequency response from Nyquist diagram using the direct construction method. 
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-360 -270 -180 -90 0 


-1 dB 

-3dB 
-6 dB 

-12 dB 

-20 dB 

-40 dB 


Open-Loop Phase (deg) 


Fig. 6.26 The Nichols chart. 


Hence 


Z^(jo;) = -/ABO 


(6.84) 


The Nichols chart 

The Nichols chart shown in Figure 6.26 is a rectangular plot of open-loop phase on 
the x-axis against open-loop modulus (dB) on the v-axis. M and N contours are 
superimposed so that open-loop and closed-loop frequency response characteristics 
can be evaluated simultaneously. Like the Bode diagram, the effect of increasing the 
open-loop gain constant K is to move the open-loop frequency response locus in the 
v-direction. The Nichols chart is one of the most useful tools in frequency domain 
analysis. 

Example 6.5 

For the control system given in Example 6.4, determine 

(a) The controller gain K\ to give the best flatband response. What is the bandwidth, 
gain margin and phase margin? 

(b) The controller gain K\ to give a peak modulus M p of 3dB. What is the band- 
width, gain margin and phase margin? 
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(c) For the controller gain in (b), what, in the time domain, is the rise-time, settling 
time and percentage overshoot? 

Solution 

(a) The open-loop transfer function for Example 6.4 is given by equation (6.55) 

CM " W = ^ + t + 4) < 6 - 85 > 

Figure 6.27 (see also Appendix 1, fig627.m) shows the Nichols chart for K = 4 
(controller gain K\ = 1). These are the settings shown in the Bode diagram in Figure 
6.23(a), curve (i), and (b), where 


Gain margin = 6 dB 
Phase margin = 50° 

From Figure 6.27 it can be seen that the peak modulus M p is 4dB, occurring at 
= 1.63 rad/s. The bandwidth iub is 2.2 rad/s. For the best flatband response, the 
open-loop frequency response locus should follow the 0 dB M contour for as wide 


OdB 



Fig. 6.27 Nichols chart for Example 6.5, K = 4. 
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Fig. 6.28 Nichols chart showing best flatband response (curve (a)) and response with M p =3dB (curve (b)). 

a frequency range as possible. This is shown in Figure 6.28, curve (a). To obtain curve 
(a), the locus has been moved down by 2 dB from that shown in Figure 6.27. This 
represents a gain reduction of 

gain reduction factor = alog( — 2/20) = 0.8 (6.86) 

Hence, for best flatband response 

K = 4.0 x 0.8 = 3.2 (6.87) 

Controller gain K\ = Kj 4 = 3.2/4 = 0.8 (6.88) 

From Nichols chart 

Gain margin = 8.15 dB 

Phase margin = 60° (6.89) 

Bandwidth = 2.02 rad/s 


(b) To obtain curve (b), the locus has been moved down by 0.5 dB from that shown 
in Figure 6.27. This represents a gain reduction of 

gain reduction factor = alog(— 0.5/20) = 0.944 


(6.90) 
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10 1 10 ° 10 1 

Frequency (rad/s) 

Fig. 6.29 Closed-loop frequency response showing best flatband response (curve (b)) and response with 
M p =3dB (curve (a)). 

Hence, for a peak modulus of M p = 3 dB, 

K = 4.0 x 0.944= 3.8 (6.91) 

Controller gain K\ = K/4 = 3.8/4 = 0.95 (6.92) 


From Nichols chart 


Gain margin = 6.36 dB 

Phase margin = 53° (6.93) 

Bandwidth = 2.1 rad/s 

Figure 6.29 (see also Appendix 1 ,fig629.m) shows the closed-loop modulus frequency 
response. Curve (a) is the best flatband response, curve (b) is the response with M p set 
to 3 dB. 


6.6 Compensator design in the frequency domain 


In section 4.5, controllers, particularly PID controllers for closed-loop systems were 
discussed. In Chapter 5 it was demonstrated how compensators could be designed 
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in the .v-plane to improve system performance. In a similar manner, it is possible 
to design compensators (that are usually introduced in the forward path) using 
frequency domain techniques. 

The general approach is to re-shape the open-loop frequency response locus 
G(jw)ff(jw) in such a manner that the closed-loop frequency response meets a given 
frequency domain specification in terms of bandwidth and peak modulus. 

PD cascade compensation : In Chapter 5, case-study Example 5.10, it was demon- 
strated how a cascaded PD compensator could improve both system performance 
and stability. However, in this chapter, Figure 6.10 gives the frequency response 
characteristics of a PD controller/compensator. The important thing to note about 
Figure 6.10 is that, in theory, above u>=l/T, the log modulus increases at 
+6dB/octave for evermore. In practice this will not happen because eventually 
system elements will saturate. But what will happen, however, is that any high 
frequency noise in the system will be greatly amplified. It therefore becomes neces- 
sary, in a practical application, both with PD and PID controllers, to introduce, at 
some suitable high frequency, a low-pass filter. 


6.6.1 Phase lead compensation 

A phase lead compensator is different from the first-order lead system given in 
equation (6.35) and Figure 6.10 because it contains both numerator and denominator 
first-order transfer functions. 


(a) Passive lead compensation 

A passive lead network (using two resistors and one capacitor) has a transfer func- 
tion of the form 


G(s) 


1 (1 + aTs) 
a (1 + Ts ) 


(6.94) 


There are two disadvantages of passive lead compensation: 

(i) the time constants are linked 

(ii) the gain constant 1/a is always less than unity (called insertion loss) and addi- 
tional amplification of value a is required to maintain the value of the open-loop 
gain K. 


(b) Active lead compensation 

An active lead compensation network is shown in Figure 6.30. For an inverting 
operational amplifier 


Vo 

Vi 


(s) 


Zf 

Zi 


(6.95) 


where Z; = input impedance and Zf = feedback impedance. 
Now 


1 

z- 




1 + RiCis 

Ri 



180 Advanced control engineering 


fi 2 



Fig. 6.30 Active lead compensation network. 


Hence 


Z; = 


R i 

1 + /?lCii 


and 


z - Rl - 

1 + R 2 C 2 s 

Inserting equations (6.96) and (6.97) into (6.95) 

Vo () _ -Ri ( 1 + RiCis ] 

Vi (S) ^ \ 1 + R 2 C 2 s) 


or, in general 


G(s) = K\ 


1 + T\s 
1 + T 2 s 


(6.96) 


(6.97) 


(6.98) 


(6.99) 


Thus from equation (6.99) it can be seen that the system designer has complete 
flexibility since, K\, T\ and T 2 are not linked. For a lead network, T\ must be greater 
than T 2 . The Bode diagram for an active lead network is shown in Figure 6.31. 
From equation (6.99) 


G(jw) = Ki 


f q+ja/r,) ] 

1(1 +)uT 2 )\ 


KiO+jq^Xl-ju;^) 

(1 +w 2 T 2 2 ) 


( 6 . 100 ) 


expanding 


G(')'jJ) 


7^i(l — j U 1 T 2 +]u)T\ + T\T 2 ij?) 
(1 +w 2 T 2 2 ) 


( 6 . 101 ) 


giving 


G(]uj) 


^i{(l + TjT 2 ur) +)u)(T\ — 7~2)| 
(1 +w 2 T 2 2 ) 


( 6 . 102 ) 


From equation (6.20) 


tan (j> = 


cu(Ti - 7V) 
(1 + TiT 2 u 2 ) 


(6.103) 
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_J_ Frequency (rad/s) J_ 
7~i T 2 

(a) Log Modulus 



(b) Phase Advance 

Fig. 6.31 Frequency response characteristics of a lead compensator. 

To find ui m , differentiate equation (6.103) with respect to w, and equate to zero. This 
gives 

1 

co m — 


v/7773 


(6.104) 
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0m 

(degrees) 



Fig. 6.32 Relationship between 0 m and the spacing of 1 /T) and 1 /f 2 in octaves. 

Substituting equation (6.104) into (6.103) to give 

= (6105) 

The value of (/> m depends upon the spacing of 1/7) and 1/7) on the logo; axis, see 

Figure 6.32. 

Design procedure for lead compensation 

1. Set K to a suitable value so that any steady-state error criteria are met. 

2. Plot the open-loop frequency response and obtain the phase margin and the 
modulus crossover frequency, (i.e. the frequency at which the modulus passes 
through 0 dB) 

3. Set u> m to the modulus crossover frequency and estimate the phase advance </> m 
required to provide a suitable phase margin. From equations (6.104) and (6.105), 
determine 7) and 7). 

4. Plot the compensated system open-loop frequency response. Note that the 
modulus crossover frequency has now increased. Reduce the compensator gain 
K\ so that the modulus crossover frequency returns to its original value, and the 
desired phase margin is met. 

Case study 

Example 6.6 

The laser guided missile shown in Figure 5.26 has an open-loop transfer function 

(combining the fin dynamics and missile dynamics) of 

20 


G(s)H(s) 


s 2 {s + 5) 


(6.106) 
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-240 -220 -200 -180 -160 -140 -120 -100 -80 -60 


Open-Loop Phase (deg) 

Fig. 6.33 Nichols chart for uncompensated laser guided missile. 


Design a cascade lead compensator that will ensure stability and provide a phase 
margin of at least 30°, a bandwidth greater than 5 rad/s and a peak closed-loop 
modulus M p of less than 6dB. 

Solution 

The open-loop transfer function is third-order type 2, and is unstable for all values of 
open-loop gain K, as can be seen from the Nichols chart in Figure 6.33. From Figure 
6.33 it can be seen that the zero modulus crossover occurs at a frequency of 1 .9 rad/s, 
with a phase margin of —21°. A lead compensator should therefore have its max- 
imum phase advance </> m at this frequency. Flowever, inserting the lead compensator 
in the loop will change (increase) the modulus crossover frequency. 

Lead compensator design one 

Place u) m at the modulus crossover frequency of 2 rad/s and position the compen- 
sator corner frequencies an octave below, and an octave above this frequency. Set 
the compensator gain to unity. Flence 


tu m = 2 rad/s 1/7) = 1 rad/s 1/7) = 4 rad/s 
K= 1.0 </> m = 36.9° 
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-240 -220 -200 -180 -160 -140 -120 -100 -80 -60 

Open-Loop Phase (deg) 


Fig. 6.34 Nichols chart for lead compensator, design one. 


The compensator is therefore 


G(s) 


(1+J) 

(1 + 0.25s) 


(6.107) 


The Nichols chart for the uncompensated and compensated system (curve (a)) is shown 
in Figure 6.34 (see also Appendix 1 ,fig634.m). From Figure 6.34, curve (a) 

Gain margin = 2 dB 
Phase margin = 4° 

Modulus crossover frequency = 3.0 rad/s 

Figure 6.35 shows the Bode gain and phase for both compensated and uncompen- 
sated systems. From Figure 6.35, it can be seen that by reducing the open-loop gain 
by 5.4 dB, the original modulus crossover frequency, where the phase advance is 
a maximum, can be attained. 

Gain reduction = alog 



= 0.537 


(6.108) 


Classical design in the frequency domain 1 85 


Hence the lead compensator transfer function is 


G(s) 


0.537(1 + s) 
(1+0.255) 


(6.109) 


The open-loop frequency response contours for the compensator given in equation 
(6.109) are curves (b) in Figures 6.34 and 6.35 which produce 

Gain margin = 7 clB 
Phase margin = 1 5° 

Modulus crossover frequency = 2 rad/s 



Frequency (rad/s) 
(a) Bode Gain 



ICT 1 10° 2 10 1 

Frequency (rad/s) 

(b) Bode Gain 


Fig. 6.35 Bode gain and phase for lead compensator, design one. 
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Frequency (rad/s) 

Fig. 6.36 Closed-loop frequency response for lead compensator one. 


Figure 6.36 shows the closed-loop frequency response using lead compensator one 
and defined by equation (6.109) (modulus only). From Figure 6.36 

Peak modulus M p = 11.6dB 
Bandwidth = 3.4 rad/s 

This design does not meet the performance specification. 


Lead compensator design two 

From Figure 6.34 it can be seen that to achieve the desired phase margin of at least 
30° then the compensator must provide in the order of an additional 20° of phase 
advance, i.e. 57° in total, at the modulus crossover frequency. 

From Figure 6.32, this suggests four octaves between the corner frequencies. Let 
1/7) remain at 1 rad/s and Position 1/73 at 16 rad/s (4 octaves higher). This provides 


0m = 61.9° 
w m = 4 rad/s 


The design two compensator is therefore 


G(s) 


(1+J) 

(1 +0.0625.9) 


( 6 . 110 ) 


The open-loop Bode gain and phase with the lead compensator given in equation 
(6.1 10) inserted in the control loop is shown in Figure 6.37. From Figure 6.37 curve (i) 
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it can be seen that the modulus crossover frequency is 3.37 rad/s, and the phase 
margin is (180— 152.4), or 27.6°. This is close to, but does not quite achieve the 
specification. However, from Figure 6.37, the maximum phase advance of —145.3° 
occurs at 1.9 rad/s. At this frequency, the open-loop gain Kis 6.8 dB. Therefore, if the 
open-loop gain is reduced by this amount as shown in Figure 6.37, curve (ii) then the 
modulus crossover frequency becomes 1.9 rad/s and the phase margin is (180 - 
145.3), or 34.7°, which is within specification. The compensator gain K\ therefore 
becomes 

Ai = al °g(^) = 0.457 (6.111) 




Frequency (rad/s) 
(b) Bode Phase 


Fig. 6.37 Open-loop bode gain and phase for design two lead compensator. 
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Open-Loop Phase (deg) 

Fig. 6.38 Nichols chart for lead compensator design two. 


Figure 6.38, curve (a) shows the Nichols chart for the value of K\ given in equation 
(6.111). It can be seen that M p = 5dB, but the bandwidth is 3.43 rad/s, which is 
outside of specification. Flowever, because of the shape of the locus, it is possible to 
reduce the gain margin (18.6 dB in curve (a)) which will increase the bandwidth, but 
not significantly change the peak modulus, or the phase margin. Figure 6.38, curve 
(b) shows the open-loop gain K increased by 4.85 dB. This now has a peak modulus 
of 5.5 dB, a phase margin of 30.6° and a bandwidth of 5.09 rad/s, all of which are 
within specification. The new compensator gain K\ is therefore 

Ki = 0.457 xalog^) 

= 0.457 x 1.748 = 0.8 (6.112) 


The final lead compensator is 


G(s) 


0.8(1 + s) 

(1 + 0.0625s) 


(6.113) 
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Frequency (rad/s) 

Fig. 6.39 Closed-loop frequency response for both lead compensator designs. 

System frequency domain performance 

Closed-loop peak M p = 5.5 dB 
Gain margin = 13.75 dB 
Bandwidth = 5.09 rad/s 
Phase margin = 30.6° 

Figure 6.39 shows, for both lead compensator designs, the closed-loop frequency 
response characteristics for the system. 


6.6.2 Phase lag compensation 


Using passive components, a phase lag compensator may be constructed, whose 
transfer function is of the form 


(1 + Ts) 




(1 +aTs) 


(6.114) 


where ct is a number greater than unity. Passive lag networks suffer the same 
disadvantages of passive lead networks as discussed earlier. 

The active network shown in Figure 6.30 has the transfer function given in 
equation (6.99) 


G(s) 


K\ ( 1 + Tis) 


(1 + T 2 s) 


(6.115) 
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Fig. 6.40 Frequency response characteristics of a lag compensator. 

When 73 is greater than 7) equation (6.115) is an active lag network, whose Bode 
diagram is shown in Figure 6.40. The relationships between 7), Tj, oj m and </> m are as 
given in equations (6.104) and (6.105), except, in this case, </> m is negative. The same 
comment applies to Figure 6.32 which shows the relationship between the spacing of 
reciprocals of 73 and 7) and <f> m . 

Design procedure for lag compensation 

1. Set K to a suitable value so that any steady-state error criteria are met. 

2. Identify what modulus attenuation is required to provide an acceptable phase mar- 
gin and hence determine the spacing between 1/73 and 1/7) (i.e. 6dB attenuation 
requires a one octave spacing, 12 dB attenuation needs a two octave spacing, etc.). 

3. Position 1/7) one decade below the compensated modulus crossover frequency, 
and hence calculate w m using equation (6.104). 

4. Adjust compensator gain K\ if necessary. 
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Case study 

Example 6.7 

A process plant has an open-loop transfer function 


G(s)H(s) 


30 

(1 +0.5j)(1 +j)( 1 + 10s) 


(6.116) 


As it stands, when the loop is closed, the system is on the verge of instability, with a 
GM of 1.4 dB, a PM of 4° and a modulus crossover frequency of 1.4 rad/s. Reducing 
the open-loop gain A' by 12 dB (i.e. K = 7.5) provides an acceptable GM of 13.5 dB, 
PM of 52° with a modulus crossover frequency of 0.6 rad/s. However, this gain 
setting produces an unacceptable step steady-state error of 12%. Design a lag 
compensator that maintains the open-loop gain K at 30, but provides gain and phase 
margins, similar to setting K at 7.5. What is now the steady-state step error? 

Solution 

Required modulus attenuation is 12 dB. This reduces the modulus crossover fre- 
quency from 1 .4 to 0.6 rad/s. 

Position 1/7) one decade below 0.6 rad/s i.e. 0.06 rad/s. For a 12 dB attenuation, 
two octaves are required in the compensator, thus 1/73 is positioned at 0.015 rad/s. 
From equation (6.104) w m is 0.03 rad/s, and from equation (6.105) (using a negative 
value), 4> m = -36.9°. 

Hence the required lag compensator is 


G(s) 


K\{1 + 16.67s) 
(1 + 66.67s) 


(6.117) 


The compensated and uncompensated open-loop frequency response is shown in 
Figure 6.41. From this Figure the compensated gain margin is 12.5 dB, and the phase 
margin is 48°. In equation (6. 117), K\ does not need to be adjusted, and can be set to 
unity. When responding to a step input, the steady-state error is now 4.6%. 


6.7 Relationship between frequency response and time 
response for closed-loop systems 

There are a few obvious relationships between the frequency response and time 
response of closed-loop systems: 

(i) As bandwidth increases, the time response will be more rapid, i.e. the settling 
time will decrease. 

(ii) The larger the closed-loop peak M v , the more oscillatory will be the time 
response. 
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Frequency (rad/s) 



Fig. 6.41 Lag compensated and uncompensated open-loop bode diagram for Example 6.7. 


Since many closed-loop systems approximate to second-order systems, a few inter- 
esting observations can be made. For the case when the frequency domain specifica- 
tion has limited the value of M v to 3dB for a second-order system, then from 
equation (6.72) 

£ = 0.38 

tu p = 0.84w n (frequency that M p occurs) (6.118) 

wb = l-4w n (bandwidth) 
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Equation (3.73) gives the time for a second-order system to settle down to within a 
tolerance band of ±2% 


or 


ts ' 


3.912 

(Mi 


Inserting the values in equation (6.118) into equation (6.119) gives 

10.29 _ 14.4 
Wb 


U = 


(6.119) 


( 6 . 120 ) 


Thus the settling time is inversely proportional to the bandwidth. Comparing equa- 
tion (6.70) with equation (3.68) gives 


% overshoot = e 2<;2,rM p x 1 00 


( 6 . 121 ) 


Hence a closed-loop system with an undamped natural frequency of 1.0 rad/s and a 
damping ratio of 0.38 has the following performance: 

• Frequency domain 

M p (equation (6.70)) = 1.422 = 3.06 dB 
tu B (equation (6.72)) = 1.4 rad/s. 


• Time domain 

t s (equation (6.120)) = 10.29 seconds 
% overshoot (equation (6.121)) = 27.5% 


6.8 Further problems 


Example 6.8 

A spring-mass-damper system has a mass of 20 kg, a spring of stiffness 8000 N/m 

and a damper with a damping coefficient of 80 Ns/m. The system is excited by a 

constant amplitude harmonic forcing function of the form 

F(t) — 160 sin tut 

(a) Determine the system transfer function relating F(t) and x(t) and calculate values 
for tu n and f. 

(b) What are the amplitudes of vibration when u> has values of 1.0, 20 and 50 rad/s. 

(c) Find the value of the damping coefficient to give critical damping and hence, with 
this value, determine again the amplitudes of vibration for the angular frequen- 
cies specified in (b). 

Solution 

(a) tu n = 20 rad/s, ( = 0.1 

(b) 0.02 m, 0.1 m and 0.0038 m 

(c) C = 800 Ns/m 0.02 m, 0.01 m and 0.0028 m 
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Example 6.9 

Construct, using asymptotes and standard second-order phase diagrams, the Bode 
diagrams for 


(i) G(s) = 

(ii) G(s) = 


12 


(1 + 2s) 


(hi) G(s) = 4 


(0.0025s 2 + 0.015 + 1) 
1+25 


1+0.55 


(iv) G(s)H(s) = 


0.5 


5 ( 5 2 + 0.55 + 1 ) 


When the loop is closed, will the system in (iv) be stable or unstable? 


Solution 

The system will have marginal stability. 


Example 6.10 

A control system has an open-loop transfer function 

Gm,S) = 40.25^ /(US, + 1) 

Set K = 1 and plot the Nyquist diagram by calculating values of open-loop modulus 
and phase for angular frequency values from 0.8 to 3.0 rad/s in increments of 
0.2 rad/s. Hence find the value of K to give a gain margin of 2 (6dB). What is the 
phase margin at this value of KP 

Solution 

K = 0.5, Phase margin = 82° 


Example 6.11 

An open-loop frequency response test on an unknown system produced the following 
results: 


ui (rad/s) 0.2 0.4 0.8 1.6 3.0 4.0 4.6 5 6 8 10 20 40 

|G(jw)i/(jw)| (dB) 28 22 16 10.7 7.5 7.3 7.0 6.0 0.9 -9.3 -28 -36 -54 

(deg)— 91 -92 -95 -100 -115 -138 -162 -180 -217 -244 -259-262-266 


Plot the Bode diagram on log-linear paper and determine 

(a) The open-loop transfer function. 

(b) The open-loop gain constant K to give a gain margin of 4.4 dB. What is the phase 
margin for this value of KP 

(c) The closed-loop transfer function (unity feedback) for the value of K found in (b). 

(d) The closed-loop peak modulus M p and bandwidth. 
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Table 6.5 Open-loop frequency response data 


uj (rad/s) 

0.1 

0.3 

0.7 

1.0 

1.5 

2.0 

3.0 

5.0 

10.0 

|G(ja>)iT(ju4| (dB) 

17 

7 

0.5 

-2 

-5 

-9 

-18.5 

-33 

-51 

tGQuj)H(]uj) (deg) 

-92 

-98 

-112 

-123 

-150 

-180 

-220 

-224 

-258 


Solution 

(a) G(s)ff(s) = .'(0.04,4 o.1,+ 1) 

(b) K = 1.5, Phase margin = 79° 

(c) C ( o = ^ 

K ) R K > s } + 2.5s 2 + 25s + 37.5 

(d) M p = 4.6 dB, ti) B = 5.6 rad/s. 

Example 6.12 

(a) An open-loop frequency response test on a unity feedback control system pro- 
duced the data given in Table 6.5. Plot the Bode Diagram and determine the 
system open-loop and closed-loop transfer functions. What are the phase and 
gain margins? 

(b) A phase lead compensation network of the form 


G(s) 


1 (1 + aTs) 
a (1 + Ts) 


is to be introduced in the forward path. The maximum phase advance 4> m is to be 
37° and is to occur at cj m = 2 rad/s. Determine the expression for the phase angle 
( i i and hence prove that 0 m and w m are as given below. Find from these expres- 
sions the values of a and T and calculate values for (f) when uj = 1, 1.5, 2, 3 and 
5 rad/s. Plot the compensator frequency response characteristics. 


4n = tan 


a — 1 
2 sfa 


OJm 


1 


T sfa 


(c) Produce a table using the frequencies specified in part (a) for the compete open- 
loop frequency response including the compensation network and an amplifier to 
make up the insertion loss of 1 /a. 

Plot these results on a Nichols chart and determine 

(!) Maximum closed-loop peak modulus, M p 
(ii) Bandwidth (to —3 dB point) 
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Solution „ _ 

(a) ° {s)H{s) = ,(0.25, 2 + 0.5, + 1) 

£, s) = 1 

R y ’ 0.356.V 3 + 0.714? 2 + 1.429s + 1 

Phase margin = 66° and Gain margin = 9 dB 

(b,ow =i{<i^} 

(c) Mp = 1 dB and Bandwidth = 2.7 rad/s 
Example 6.13 

(a) A unity feedback control system has an open-loop transfer function 

G(s)H(s) = 1 

s(l + s)( 1 + 0.5.v) 


Construct, using asymptotes, the Bode diagram and read off values of open-loop 
modulus and phase for the following frequencies 

u> (rad/s) = 0.1, 0.5, 1.0, 1.4, 2.0, 4.0, 6.0 and 10.0 

You may assume that at frequencies of 1.0 and 2.0 rad/s the open-loop phase angles 
are —162° and —198° respectively. 

Plot the results between 0. 1 and 2.0 rad/s on a Nichols Chart and determine 

(i) the phase and gain margins 

(ii) the maximum closed-loop modulus M p 

(iii) the bandwidth to the — 3dB point 

(b) The performance specification calls for a maximum closed-loop modulus of 
+ 1 dB and a bandwidth of at least 1.8 rad/s. In order to achieve this, the follow- 
ing active lead compensation element is placed in the forward path 


G(s) 


K x {\ + Tis) 
(1 + T 2 s) 


Show that the phase advance 0 is given by 


<j> = tan 


oAji - r 2 y 
i + r, t 2 uj 2 


The frequency of maximum phase advance is to occur at the frequency that corre- 
sponds to —180° on the Bode diagram constructed in section (a). The lower break 
frequency 1/7) is to be half this value and the upper break frequency 1/73 is to be 
twice this value. Evaluate 7) and 7? and calculate values of </> for the frequencies 
specified in section (a). Construct the Bode diagram for the compensation element 
for the condition K\ = 1, and read off values of modulus at the same frequencies as 
the calculated phase values. 
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(c) Using the tables of modulus and phase for the plant and compensator found in 
sections (a) and (b), determine values for the new overall open-loop modulus and 
phase when the compensator is inserted in the forward path. 

Plot these results on a Nichols Chart and adjust the compensator gain K\so that the 
system achieves the required performance specification. 

What are now the values of 


(i) the phase and gain margins 

(ii) the maximum closed-loop modulus, M p 

(iii) the bandwidth 

(iv) the compensator gain constant K\ 


Solution 

(a) (i) Phase margin = 32° and Gain margin = 9.6 dB 

(ii) M p = 5 dB 

(iii) Bandwidth = 1.3 rad/s 


(b) G(s) 


K\{\ + 1.429 s) 
(1 +0.3575) 


(c) (i) Phase margin = 47° and Gain margin = 13.5 dB 

(ii) M p = 1 dB 

(iii) Bandwidth = 1.85 rad/s 

(iv) K\ = 0.861 



7 


Digital control system 
design 


7.1 Microprocessor control 

As a result of developments in microprocessor technology, the implementation of 
control algorithms is now invariably through the use of embedded microcontrollers 
rather than employing analogue devices. A typical system using microprocessor 
control is shown in Figure 7.1. 

In Figure 7. 1 

• RAM is Random Access Memory and is used for general purpose working space 
during computation and data transfer. 

• ROM, PROM, EPROM is Read Only Memory, Programmable Read Only Mem- 
ory and Erasable Programmable Read Only Memory and are used for rapid 
sources of information that seldom, or never need to be modified. 

• A/D Converter converts analogue signals from sensors into digital form at a 
given sampling period T seconds and given resolution (8 bits, 16 bits, 24 bits, 
etc.) 

• D/A Converter converts digital signals into analogue signals suitable for driving 
actuators and other devices. 

The elements of a microprocessor controller (microcontroller) are shown in Figure 
7.2. Figure 7.2 shows a Central Processing Unit (CPU) which consists of 

• the Arithmetic Logic Unit (ALU) which performs arithmetic and logical oper- 
ations on the data 

and a number of registers, typically 

• Program Counter - incremented each time an instruction is executed 

• Accumulator(s) - can undertake arithmetic operations 

• Instruction register - holds current instruction 

• Data address register - holds memory address of data 

Control algorithms are implemented in either high level or low level language. The 
lowest level of code is executable machine code, which is a sequence of binary 
words that is understood by the CPU. A higher level of language is an assembler, 
which employs meaningful mnemonics and names for data addresses. Programs 
written in assembler are rapid in execution. At a higher level still are languages 
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Fig. 7.1 Microprocessor control of a plant. 


program counter 


ALU 

accumulator(s) 




instruction register 


data address register 

CPU 


clock 


address bus 


data bus 


RAM 


ROM 

PROM 

EPROM 


Fig. 7.2 Elements of a microprocessor controller. 


such as C and C++, which are rapidly becoming industry standard for control 
software. 

The advantages of microprocessor control are 

• Versatility - programs may easily be changed 

• Sophistication - advanced control laws can be implemented. 
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The disadvantages of microprocessor control are 

• Works in discrete time - only snap-shots of the system output through the A/D 
converter are available. Hence, to ensure that all relevant data is available, the 
frequency of sampling is very important. 


7.2 Shannon's sampling theorem 

Shannon’s sampling theorem states that ‘A function /(t) that has a bandwidth tub is 
uniquely determined by a discrete set of sample values provided that the sampling 
frequency is greater than 2uV. The sampling frequency 2wb is called the Nyquist 
frequency. 

It is rare in practise to work near to the limit given by Shannon’s theorem. A useful 
rule of thumb is to sample the signal at about ten times higher than the highest 
frequency thought to be present. 

If a signal is sampled below Shannon’s limit, then a lower frequency signal, called 
an alias may be constructed as shown in Figure 7.3. 

To ensure that aliasing does not take place, it is common practice to place an anti- 
aliasing filter before the A/D converter. This is an analogue low-pass filter with a 
break-frequency of 0.5cu s where lu s is the sampling frequency (w s > 10wb)- The higher 
uj s is in comparison to Wb> the more closely the digital system resembles an analogue 
one and as a result, the more applicable are the design methods described in Chapters 
5 and 6. 



Fig. 7.3 Construction of an alias due to undersampling. 
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7.3 Ideal sampling 

An ideal sample f*{t) of a continuous signal f(t) is a series of zero width impulses 
spaced at sampling time T seconds apart as shown in Figure 7.4. 

The sampled signal is represented by equation (7.1). 

OO 

fit) = Y, f( kT Wt - kT) (7.1) 

k — — oo 

where 6(t — kT) is the unit impulse function occurring at t = kT. 

A sampler (i.e. an A/D converter) is represented by a switch symbol as shown in 
Figure 7.5. It is possible to reconstruct /(r) approximately from/*(t) by the use of a 
hold device, the most common of which is the zero-order hold (D/A converter) as 
shown in Figure 7.6. From Figure 7.6 it can be seen that a zero-order hold converts a 
series of impulses into a series of pulses of width T. Flence a unit impulse at time t is 
converted into a pulse of width T, which may be created by a positive unit step at 
time t, followed by a negative unit step at time ( t — T ), i.e. delayed by T. 

The transfer function for a zero-order hold is 

nm] = -- 

s s 

(7.2) 

1 - e~ r ' s 
G h (s) = 



(a) Continuous Signal (b) Sampled Signal 


Fig. 7.4 The sampling process. 


f(t) 



m 


Fig. 7.5 A sampler. 
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(a) Discrete Time Signal (b) Continous Time Signal 

Fig. 7.6 Construction of a continuous signal using a zero-order hold. 


7.4 The z-transform 


The z-transform is the principal analytical tool for single-input-single-output dis- 
crete-time systems, and is analogous to the Laplace transform for continuous systems. 

Conceptually, the symbol z can be associated with discrete time shifting in a 
difference equation in the same way that s can be associated with differentiation in 
a differential equation. 

Taking Laplace transforms of equation (7.1), which is the ideal sampled signal, 
gives 

OO 

F*(s) = nf*(0\ = E/(^)e"“ (7-3) 

*=o 


or 


Define z as 


OO 

F*(s) = J2f(kT)(c sT ) 

k=0 


(7.4) 


z = e 1 


,sT 


(7.5) 


then 


F(:) = J2f(kT)z~ k = Z[f(t)\ 


k = 0 


In ‘long-hand’ form equation (7.6) is written as 

m =/(0) +f(T)z- 1 +f(2T)z~ 2 + ■■■ +f(kT)z~ k 


(7.6) 


(7.7) 


Example 7.1 

Find the z-transform of the unit step function /(t) = 1. 
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Fig. 7.7 z-Transform of a sampled unit step function. 


Solution 

From equations (7.6) and (7.7) 

OO 

Z[l(t)] = UkT)z- k (7.8) 

h=0 

or 

F(z) = 1 + r _1 + :~ 2 + . . . + z~ k (7.9) 

Figure 7.7 shows a graphical representation of equation (7.9). 

Equation (7.9) can be written in ‘closed form’ as 

Z[ 1 ( 0 ] = — ^ — r (7.10) 

z — 1 1 — z~ l 

Equations (7.9) and (7.10) can be shown to be the same by long division 

l+z~' +z~ 2 -\ 

c: — l) “ 0 0 

z — 1 

0+1 

1 - r- 1 

0 + r” 1 

— r -2 (7.11) 

Table 7.1 gives Laplace and r-transforms of common functions, 
r-transform Theorems: 

(a) Linearity 


Z[/,(0 ±f 2 (t)] = F\(z) ± F 2 (z) 


(7.12) 
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Table 7.1 

Common Laplace and 

r-transforms 



f{t) or f{kT) 

m 

m 

1 

m 

i 

i 

2 

6(t - kT) 

e~ kTs 


3 

l(t) 

1 

s 

z 

z — 1 

4 

t 

1 

? 

Tz 

(z-lf 

5 

e~ at 

1 

z 


(s + a) 

Z — Q~ aT 

g 

\ _ Q-at 

a 

z(l - e~ aT ) 



s(s + a) 

(z - 1 )(z- e-" 7- ) 

7 

- (a; — 1 + e~ a ‘) 
a 

a 

:{(ar - 1 + e~ aT )z + (1 - t-" T - aTe~ aT )} 


s 2 (s + a) 

a(z — l) 2 (r — e~ aT ) 

8 

sin ujt 

to 

zsinwr 

S 2 + UJ 2 

z 2 — 2zcosa;r + 1 

9 

COS Ujt 

s 

z(z — cos ujT) 


S 2 + UJ 2 

z 1 — 2z cos uj T + 1 

10 

e~ al sinca? 

UJ 

ze~ aT sin ujT 

is + af + tc 2 

z 2 — 2ze~ aT cost oT + e~ 2aT 

11 

e~ a ‘ cos ut t 

is + a) 

z 2 — zz~ aT cos uiT 

is + af + u2 

z 2 — 2 ze~ aT cost oT + e~ 2aT 


(b) Initial Value Theorem 

/( 0) = lim F(z) 

z — >oo 

(c) Final Value Theorem 


/( oo) = lim 

Z — > 1 



( 7 . 13 ) 


( 7 . 14 ) 


7.4.1 Inverse transformation 

The discrete time response can be found using a number of methods. 

(a) Infinite power series method 

Example 7.2 

A sampled-data system has a transfer function 

1 
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If the sampling time is one second and the system is subject to a unit step input 
function, determine the discrete time response. (N.B. normally, a zero-order hold 
would be included, but, in the interest of simplicity, has been omitted.) Now 


from Table 7.1 


X 0 (z) = G(z)X i (z) 


X 0 (z) = 

for T = 1 second 

X Q (z) = 

= z 2 - 1.368z + 0.368 

By long division 

1 + 1.368_~' + 1.503z~ 2 + • • • 
z 2 - 1.368z + 0.368p 0 0 0~ 

z 2 - 1.368z + 0.368 
0+ 1.3682-0.368 

1.3682- 1.871 + 0.503Z -1 

0+ 1.503 - 0.5032-* 
1.503 - 2.056Z" 1 




0.553z -2 


(7.15) 

(7.16) 


(7.17) 


(7.18) 


Thus 


x o (0) = 1 


jc 0 (1)= 1.368 


x 0 (2) =1.503 


(b) Difference equation method 

Consider a system of the form 

X 0 _ bo + b\z 1 + b 2 z 2 + • • • 

Xj 1 + oiz -1 + ci 2 z~ 2 H 

Thus 

(1 + aiz -1 + ci 2 Z~ 2 H )X Q (z) = (bo + b\z~ l + b 2 z~ 2 H )l)(z) 

or 

X 0 (z ) = (-ci\z~ x - a 2 z ~ 2 - • • • )X Q (z ) + (bo + b\z~ x + b 2 z ~ 2 + • • • )Tj(z) 
Equation (7.21) can be expressed as a difference equation of the form 
x 0 (kT) = — ai-v 0 (A’ — 1 )T — a 2 x 0 (k — 2 )T — ■ ■ ■ 


+ boXi(kT) + b\Xi(k — 1 )T + b 2 X[(k — 2 )T H 


(7.19) 

(7.20) 

(7.21) 


(7.22) 



206 Advanced Control Engineering 


In Example 7.2 


Xi 


(s) = 


1 



z 

z — 0.368 


Equation (7.23) can be written as 

*•(*) = I 

XC ’ 1 -0.368^' 

Equation (7.24) is in the same form as equation (7.19). Hence 


(1 - 0.368r-')Jr o (r) = Xi(r) 


(7.23) 


(7.24) 


or 

X 0 (z) = 0.368 z~ x X 0 (z) + X t (z) (7.25) 

Equation (7.25) can be expressed as a difference equation 

Xo(kT) = 0.368 x 0 (k -l)T + Xi(kT) (7.26) 

Assume that x 0 (— 1 ) = 0 and x\(kT) = 1, then from equation (7.26) 

x o (0) = 0+1 = 1, k = 0 

x 0 (l) = (0.368 x 1)+ 1 = 1.368, k= 1 

x 0 (2) = (0.368 x 1.368) + 1 = 1.503, k = 2 etc. 

These results are the same as with the power series method, but difference equations 
are more suited to digital computation. 


7.4.2 The pulse transfer function 

Consider the block diagrams shown in Figure 7.8. In Figure 7.8(a) U*(s) is a sampled 
input to G(s) which gives a continuous output X a (s), which when sampled by a 



U(z) 


G(z) 


Xo(z) 

► 


(b) 


Fig. 7.8 Relationship between G(s) and G(z). 
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U*(s) 

► 


Gi(s) 



X*(s) 

► 


G 2 (s) 



X 0 *(s) 

► 


(a) 



C*(s) ( 

G,(s) 

X(s) 

G 2 (s) 

X 0 (s) 



► 



(b) 


X 0 *(s) 

► 


Fig. 7.9 Blocks in cascade. 

synchronized sampler becomes X*(s). Figure 7.8(b) shows the pulse transfer function 
where U{z ) is equivalent to U*(s ) and X Q (z) is equivalent to A*(.y). 

From Figure 7.8(b) the pulse transfer function is 

^(z) = G(z) (7.27) 

Blocks in Cascade : In Figure 7.9(a) there are synchronized samplers either side of 
blocks Gifs) and G 2 (s). The pulse transfer function is therefore 

^(z) = G\(z)G 2 (z) (7.28) 

In Figure 7.9(b) there is no sampler between Gifs) and G 2 (s) so they can be combined 
to give Gi(s)G 2 (s), or GiG 2 fs). Hence the output X Q (z) is given by 

X 0 (z) = Z{G\G 2 (s)}U(z) (7.29) 

and the pulse transfer function is 

^(z) = G,G 2 (z) (7.30) 


Note that Gi(z)G 2 (z) / G x G 2 {z). 


Example 7.3 (See also Appendix 1, examp73.m ) 

A first-order sampled-data system is shown in Figure 7.10. 

Find the pulse transfer function and hence calculate the response to a unit step and 
unit ramp. T = 0.5 seconds. Compare the results with the continuous system 
response x 0 (t). The system is of the type shown in Figure 7.9(b) and therefore 


Inserting values 


G(s) = G\ G' 2 (.v) 


G(s) = (1 - e” r ’) 


s(s + 1) 


(7.31) 
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Xi(S) 

1 - e“ Ts 


1 

X(S) 

i * 

S 


s + 1 


T 






Fig. 7.10 First-order sampled-data system. 


Taking r-transforms using Table 7.1. 


G(z) 


(1 


z- 1 ) 


-(l~e- r ) 1 

(z- l)(z-e- r )J 


or 


which gives 


G(z) 


z-l \ ( } 

, z / Id- l)(z-e- r )J 



For T = 0.5 seconds 


hence 


G(z) 


f 0.393 \ 
\r — 0.607 ) 


X 0 ( 0.393 z- 1 \ 

X, Vl- 0.6072-7 


which is converted into a difference equation 

x 0 (kT ) = 0.607x o (k - 1)T + 0.393 x { (k - 1)3" 


(7.32) 

(7.33) 

(7.34) 

(7.35) 

(7.36) 

(7.37) 


Table 7.2 shows the discrete response x 0 (kT) to a unit step function and is compared 
with the continuous response (equation 3.29) where 

x o (0 = (l-e"0 (7.38) 


From Table 7.2, it can be seen that the discrete and continuous step response is 
identical. Table 7.3 shows the discrete response x{kT) and continuous response ,\'(t) 
to a unit ramp function where x 0 (t) is calculated from equation (3.39) 

x Q (t) = t-l+e-‘ (7.39) 

In Table 7.3 the difference between x a (kT ) and x Q (t ) is due to the sample and hold. 
It should also be noted that with the discrete response x(kT), there is only knowledge 
of the output at the sampling instant. 


Digital control system design 209 


Table 7.2 Comparison between discrete and continuous step response 


k 

kT (seconds) 

-U (kT) 

x 0 (kT) 

Xo(t) 

-1 

— 0.5 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0.5 

1 

0.393 

0.393 

2 

1.0 

1 

0.632 

0.632 

3 

1.5 

1 

0.776 

0.776 

4 

2.0 

1 

0.864 

0.864 

5 

2.5 

1 

0.918 

0.918 

6 

3.0 

1 

0.950 

0.950 

7 

3.5 

1 

0.970 

0.970 

8 

4.0 

1 

0.982 

0.982 


Table 7.3 

Comparison between discrete and continuous ramp response 

k 

kT (seconds) 

xj (kT) 

x 0 (kT) 

XoW 

-1 

-0.5 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0.5 

0.5 

0 

0.107 

2 

1.0 

1.0 

0.304 

0.368 

3 

1.5 

1.5 

0.577 

0.723 

4 

2.0 

2.0 

0.940 

1.135 

5 

2.5 

2.5 

1.357 

1.582 

6 

3.0 

3.0 

1.805 

2.050 

7 

3.5 

3.5 

2.275 

2.530 

8 

4.0 

4.0 

2.757 

3.018 


7.4.3 The closed-loop pulse transfer function 


Consider the error sampled system shown in Figure 7.11. Since there is no sampler 
between G(s ) and H(s ) in the closed-loop system shown in Figure 7.1 1, it is a similar 
arrangement to that shown in Figure 7.9(b). From equation (4.4), the closed-loop 
pulse transfer function can be written as 


In equation (7.40) 


C (z)^ ^ 

R J I + GII(z) 

GH(z) = Z{GH(s)} 


(7.40) 

(7.41) 



Fig. 7.11 Closed-loop error sampled system. 
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Fig. 7.12 Closed-loop error and output sampled system. 


Consider the error and output sampled system shown in Figure 7.12. In Figure 7.12, 
there is now a sampler between G(s ) and H(s), which is similar to Figure 7.9(a). From 
equation (4.4), the closed-loop pulse transfer function is now written as 


C (z)= ^ 

R 1 + G{z)H(z) 


(7.42) 


7.5 Digital control systems 

From Figure 7.1, a digital control system may be represented by the block diagram 
shown in Figure 7.13. 

Example 7.4 (See also Appendix 1, examp74.m ) 

Figure 7.14 shows a digital control system. When the controller gain K is unity and 
the sampling time is 0.5 seconds, determine 

(a) the open-loop pulse transfer function 

(b) the closed-loop pulse transfer function 

(c) the difference equation for the discrete time response 

(d) a sketch of the unit step response assuming zero initial conditions 

(e) the steady-state value of the system output 



C(t) 


Fig. 7.13 Digital control system. 
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Fig. 7.14 Digital control system for Example 7.4. 


Solution 
(a) G(s) = K 
Given K = 1 


1 — e 


-Ts 


1 

s(s + 2) 


G(s) = (1 — e 


-Ts) 


1 


s 2 (s + 2) 


Partial fraction expansion 


1 


A B C 


or 


s 2 (s + 2) ( s s 2 (s + 2) 

1 = s(s + 2 )A + (s + 2 )B + 


Equating coefficients gives 

A = -0.25 
5 = 0.5 
C = 0.25 

Substituting these values into equation (7.44) and (7.45) 


or 


-Ts\ f — °-25 0.5 0.25 ) 

GW = 0.25(l-e--){-G7 + _>_} 


Taking z-transforms 

G(z) = 0.25(1 -z~ l ] 
Given T = 0.5 seconds 


— z 2Tz 


(z - 1) (z - l) 2 (z e~ 2r ) 


z- 1\ r -1 2 x 0.5 


Z ) Uz-1) (z — l) 2 (z- 0.368) 


(7.43) 

(7.44) 

(7.45) 

(7.46) 


(7.47) 

(7.48) 


(7.49) 


G(z) = 0.25 


(7.50) 
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Hence 


G(z) = 0.25 (z - 1) 


-l(z- l)(z- 0.368) + (z- 0.368) + (z~iy 


G(z) = 0.25 


(z - l) z (z - 0.368) 

-z 2 + 1.368z - 0.368 + z - 0.368 + z 2 - 2z + 1 


(z- 1 )(z — 0.368) 
which simplifies to give the open-loop pulse transfer function 

0.092z+ 0.066 


G(z) = 


z 2 - 1.368z + 0.368 


(7.51) 

(7.52) 


(7.53) 


Note: This result could also have been obtained at equation (7.44) by using z-trans- 
fonn number 7 in Table 7.1, but the solution demonstrates the use of partial frac- 
tions. 

(b) The closed-loop pulse transfer function, from equation (7.40) is 


C. (. 1.368* j 0.368 ) 

— (z) = — 

R ( 1 _j_ 0.0922+0.066 ) 

y 1 r 2 — 1.3682+0.368 ) 


(7.54) 


which simplifies to give the closed-loop pulse transfer function 

C 0.092z+ 0.066 

R r) “ z 2 - 1.276z + 0.434 

or 

C 0.092Z' 1 + 0.066z" 2 

R r) “ 1 - 1.276z-> +0.434z" 2 


(7.55) 


(7.56) 


(c) Equation (7.56) can be expressed as a difference equation 


c(kT) = 1.276 c(k- l)T-0.434c(k-2)T + 0.092r(k- \)T + 0.066r(k - 2)T 

(7.57) 

(d) Using the difference equation (7.57), and assuming zero initial conditions, the 
unit step response is shown in Figure 7.15. 

Note that the response in Figure 7.15 is constructed solely from the knowledge of the 
two previous sampled outputs and the two previous sampled inputs. 

(e) Using the final value theorem given in equation (7.14) 


c(oo) = lim 

Z — > 1 



C k(z)R{z) 


(7.58) 


c(oo) = lim 

Z — > 1 



f 0.092 z + 0.066 ) / z \ 
\l - 1.276z + 0.434 J Vz - l) 


(7.59) 
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c(kT) 



Fig. 7.15 Unit step response for Example 7.4. 


c(oo) 


/ 0.092 + 0.066 \ 

\\ - 1.276 + 0.434/ “ ' 


Hence there is no steady-state error. 


(7.60) 


7.6 Stability in the z-plane 
7.6.1 Mapping from the s-plane into the z-plane 

Just as transient analysis of continuous systems may be undertaken in the .s-plane, 
stability and transient analysis on discrete systems may be conducted in the z-plane. 
It is possible to map from the .s to the z-plane using the relationship 

z = e sT (7.61) 


now 


S = (T± }U) 


therefore 


z = Q( a± i^ r = e aT e> ujT 


(using the positive j ui value) 


(7.62) 
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Fig. 7.16 Mapping from the s to the z-plane. 

If e aT = \z\ and T = 2it/lu s equation (7.62) can be written 

z = |z|e j (2 ™ /Ws) (7.63) 

where ui s is the sampling frequency. 

Equation (7.63) results in a polar diagram in the z-plane as shown in Figure 7.16. 
Figure 7.17 shows mapping of lines of constant a (i.e. constant settling time) from the 
5 to the z-plane. From Figure 7.17 it can be seen that the left-hand side (stable) of the 
5-plane corresponds to a region within a circle of unity radius (the unit circle) in the z- 
plane. 

Figure 7.18 shows mapping of lines of constant ui (i.e. constant transient fre- 
quency) from the 5 to the z-plane. 




(a) 


(b) (c) 


J 

V i 

k i 

V 


—a 

<7=0 

+(T 

i 

i. i 

k i 

i 


s-plane 



Fig. 7.17 Mapping constant a from sto z-plane. 
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\UJ 




Fig. 7.18 Mapping constant oj from s to z-plane. 


ju 




8 

CD ' 

n>I£ 

10 






5 


7 







1 

2 

3 

4 

a 





5 

6 

7 






8 

9 

10 



s-plane 

Fig. 7.19 Corresponding pole locations on both s 



z-planes. 


Figure 7.19 shows corresponding pole locations on both the .v-plane and z-plane. 


7.6.2 The Jury stability test 

In the same way that the Routh-Hurwitz criterion offers a simple method of 
determining the stability of continuous systems, the Jury (1958) stability test is 
employed in a similar manner to assess the stability of discrete systems. 

Consider the characteristic equation of a sampled-data system 

Q(z) = a„z a + a n -iz"~ l + 1- a\z + o 0 = 0 


(7.64) 
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Table 7.4 Jury’s array 


z° 

z> 

z 2 

z"-' 

z n 

do 

a\ 

a 2 

a n - 1 

d n 

a n 

a n - 1 

d n —2 

a\ 

fl 0 

bo 

b\ 

bi 

b n - 1 


b n - 1 

b n - 2 

bn- 3 




^0 

h 

h 

h 

h 

h 

h 

lo 

m 0 

m\ 

m 2 


m 2 

m\ 

m 0 



The array for the Jury stability test is given in Table 7.4 where 

h = 


ao d n —k 

&n dfc 


Ck = 


dk — 


bo b n —\—k 
bn — 1 bk 

Co C n — 2 —k 
Cn—2 Ck 


(7.65) 


The necessary and sufficient conditions for the polynomial Q(z) to have no roots 
outside or on the unit circle are 

Condition 1 Q{\) > 0 

Condition 2 (-1)"£(-1) > 0 
Condition 3 |o 0 | < a„ 

N > \b„-\\ 

|c 0 | > |c„_ 2 | 


(7.66) 


Condition n \m$\ > |m 2 | 


Example 7.5 (See also Appendix 1, examp75.m ) 

For the system given in Figure 7.14 (i.e. Example 7.4) find the value of the digital 
compensator gain K to make the system just unstable. For Example 7.4, the char- 
acteristic equation is 

1 + G(z) = 0 (7.67) 

In Example 7.4, the solution was found assuming that K = 1. Therefore, using 
equation (7.53), the characteristic equation is 

/f(0.092z + 0.066) 

+ (z 2 - 1.368s + 0.368) 


(7.68) 
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Q(z) = z 2 + (0.092 K - 1 ,368)z + (0.368 + 0.066*) = 0 (7.69) 

The first row of Jury’s array is 



z° z 1 z 2 


(0.368 + 0.066/s:) (0.092/: - 1.368) 1 


Condition 1: Q{\) > 0 
From equation (7.69) 

Q( 1) = {1 + (0.092/s: - 1.368) + (0.368 + 0.066/0} > 0 (7.71) 

From equation (7.71), (9(1) > 0 if K > 0. 

Condition 2 (— l) n Q(— 1) > 0 
From equation (7.69), when n = 2 

(-1) 2 2(-1)= {1 — (0.092A: — 1.368) + (0.368 + 0.066^)} > 0 (7.72) 

Equation (7.72) simplifies to give 

2.736 - 0.026/s: > 0 
or 


2.736 

^ < O026 = 105 - 23 (7 ' 73) 



Fig. 7.20 Root locus diagram for Example 7.4. 
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Condition 3: |«o| < «2 


For marginal stability 


|0.368 + 0.066^| < 1 


0.368 + 0.066/f = 1 


1 -0.368 
0.066 


9.58 


(7.74) 


(7.75) 


Flence the system is marginally stable when K = 9.58 and 105.23 (see also Example 
7.6 and Figure 7.20). 


7.6.3 Root locus analysis in the z-plane 

As with the continuous systems described in Chapter 5, the root locus of a discrete 
system is a plot of the locus of the roots of the characteristic equation 

1 + GH{z) = 0 (7.76) 

in the c-plane as a function of the open-loop gain constant K. The closed-loop system 
will remain stable providing the loci remain within the unit circle. 


7.6.4 Root locus construction rules 

These are similar to those given in section 5.3.4 for continuous systems. 

1. Starting points ( K = 0): The root loci start at the open-loop poles. 

2. Termination points ( K = oo): The root loci terminate at the open-loop zeros when 
they exist, otherwise at oo. 

3. Number of distinct root loci'. This is equal to the order of the characteristic 
equation. 

4. Symmetry of root loci : The root loci are symmetrical about the real axis. 

5. Root locus locations on reed axis: A point on the real axis is part of the loci if the 
sum of the open-loop poles and zeros to the right of the point concerned is odd. 

6. Breakaway points : The points at which a locus breaks away from the real axis can 
be found by obtaining the roots of the equation 

d d _ \GH(z)} = 0 

7. Unit circle crossover: This can be obtained by determining the value of K for 
marginal stability using the Jury test, and substituting it in the characteristic 
equation (7.76). 

Example 7.6 (See also Appendix 1, examp76.m ) 

Sketch the root locus diagram for Example 7.4, shown in Figure 7.14. Determine the 

breakaway points, the value of K for marginal stability and the unit circle crossover. 
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Solution 

From equation (7.43) 


G(s) = K 



1 


s(s + 2) 


and from equation (7.53), given that T = 0.5 seconds 


Open-loop poles 


G(z) = K 


f 0.0922 + 0.066 \ 
\r 2 — 1 .3682 + 0.368 J 


r 2 - 1.3682 + 0.368 = 0 


(7.77) 


(7.78) 


(7.79) 


Open-loop zeros 


2 = 0.684 + 0.316 
= 1 and 0.368 

0.092 2 + 0.066 = 0 


(7.80) 


2 = -0.717 (7.81) 

From equations (7.67), (7.68) and (7.69) the characteristic equation is 

2 2 + (0.092* - 1 .368)2 + (0.368 + 0.06670 = 0 (7.82) 

Breakaway points'. Using Rule 6 

( 2 2 - 1.368z + 0.368)*(0.092)-*(0.092z + 0.066)(2z- 1.368) = 0 (7.83) 


which gives 


0.0922 2 + 0.1322 - 0.1239 = 0 
2 = 0.647 and -2.084 


(7.84) 


K for marginal stability. Using the Jury test, the values of K as the locus crosses the 
unit circle are given in equations (7.75) and (7.73) 

K = 9.58 and 105.23 (7.85) 

Unit circle crossover: Inserting K = 9.58 into the characteristic equation (7.82) gives 

2 2 - 0.4872 + 1 = 0 (7.86) 

The roots of equation (7.86) are 

2 = 0.244 ± j0.97 (7.87) 


or 


2 = 12 + 75.9° = 1/dfc 1.33 rad 


(7.88) 
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Since from equation (7.63) and Figure 7.16 

z = |z| LujT (7.89) 

and T = 0.5, then the frequency of oscillation at the onset of instability is 


0.5cu = 1.33 
tv = 2.66 rad/s 


(7.90) 


The root locus diagram is shown in Figure 7.20. 

It can be seen from Figure 7.20 that the complex loci form a circle. This is usually 
the case for second-order plant, where 

Radius = ^ | open-loop poles | 

Centre = (Open-loop zero, 0) (7.91) 

The step response shown in Figure 7.15 is for K = 1. Inserting K = 1 into the 
characteristic equation gives 


z 2 - 1.276z + 0.434 = 0 


or 


z = 0.638 ±j0.164 

This position is shown in Figure 7.20. The K values at the breakaway points are also 
shown in Figure 7.20. 


7.7 Digital compensator design 

In sections 5.4 and 6.6, compensator design in the 5-plane and the frequency domain 
were discussed for continuous systems. In the same manner, digital compensators 
may be designed in the z-plane for discrete systems. 

Figure 7.13 shows the general form of a digital control system. The pulse transfer 
function of the digital controller/compensator is written 


U 

^(-) D(-) 

and the closed-loop pulse transfer function become 

C D(z)G(z) 

R ' 1 +D(z)GH(z) 

and hence the characteristic equation is 


(7.92) 


(7.93) 


1 + D(z)GH(z) = 0 


(7.94) 
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7.7.1 Digital compensator types 

In a continuous system, a differentiation of the error signal e can be represented as 

, , de 

Taking Laplace transforms with zero initial conditions 

^Cv) = ,y (7.95) 

In a discrete system, a differentiation can be approximated to 


u(kT) = 


e(kT) — e(k — \)T 


U {z)= 1 -^ 

E T 

Hence, the Laplace operator can be approximated to 

1 — z~ l z — 1 


Digital FID controller. From equation (4.92), a continuous PID controller can be 
written as 

+ 11 (7.98, 


Inserting equation (7.97) into (7.98) gives 


U _K i {T l T d (^) 2 +T i m + l} 

e { z) r-m 


which can be simplified to give 


U K\(b 2 z 2 + b\z + b 0 ) 
E (Z) = 


(7.100) 


where 


bi= 1- 


b2 -(Y + Y 1 + 1 


(7.101) 
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Tustin’s Rule : Tustin’s rule, also called the bilinear transformation, gives a better 
approximation to integration since it is based on a trapizoidal rather than a rect- 
angular area. Tustin’s rule approximates the Laplace transform to 


2(z-2) 

T(z+\) 


(7.102) 


Inserting this value of .9 into the denominator of equation (7.98), still yields a digital 
PID controller of the form shown in equation (7.100) where 


bo 


Td 

T 


b 1 = 



bi = 



(7.103) 


Example 7 .7 (See also Appendix 1, examp77.m ) 

The laser guided missile shown in Figure 5.26 has an open-loop transfer function 
(combining the fin dynamics and missile dynamics) of 

GW7W =?+h) (7J04) 

A lead compensator, see case study Example 6.6, and equation (6.1 13) has a transfer 
function of 


G(s) 


0.8(1 + s) 

(1 + 0.0625.9) 


(7.105) 


(a) Find the z-transform of the missile by selecting a sampling frequency of at least 
10 times higher than the system bandwidth. 

(b) Convert the lead compensator in equation (7.105) into a digital compensator 
using the simple method, i.e. equation (7.97) and find the step response of the 
system. 

(c) Convert the lead compensator in equation (7.105) into a digital compen- 
sator using Tustin’s rule, i.e. equation (7.102) and find the step response of the 
system. 

(d) Compare the responses found in (b) and (c) with the continuous step response, 
and convert the compensator that is closest to this into a difference equation. 


Solution 

(a) From Figure 6.39, lead compensator two, the bandwidth is 5.09 rad/s, or 
0.81 Hz. Ten times this is 8.1Hz, so select a sampling frequency of 10 Hz, i.e. 
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r = 0.1 seconds. For a sample and hold device cascaded with the missile 
dynamics 


G(s) = 


1 — e 


-Ts 


20 


G(s) = (1 - e~ Ts ) 


s~(s + 5) 
20 

sHs + 5) 


For T = 0.1, equation (7.107) has a z-transform of 

. 0.00296z 2 + 0.01048z + 0.0023 

G(z) = 


z 3 - 2.6065z 2 + 2.2131z - 0.6065 


(7.106) 

(7.107) 

(7.108) 


(b) Substituting 


5 = 


z — 1 

YF~ 


into lead compensator given in equation (7.105) to obtain digital compensator 

D(z) = 0.8 < 

Fhis simplifies to give 


r-+(---n ) 

T: 

T:+ 0.0625(z-l) 

• T: J 


D{z) = 


5.4152z- 4.923 
z^ 0.3846 


(7.109) 


(c) Using Tustin’s rule 


2(z-l) 
" T{z+ 1) 


Substituting into lead compensator 


D(z) = 0.8 


T(z+ l)+2(r— 1) 
H--+1) 

r(;+l)+0.0625{2(^l)} 

ff+O : 


Fhis simplifies to give 


D(z) 


IMlz - 6.756 
z- 0.1 11 


(7.110) 


(d) From Figure 7.21, it can be seen that the digital compensator formed using 
Tustin’s rule is closest to the continuous response. From equation (7.110) 


U 7.467 - 6.756z-‘ 
F (r " 1 -O.lllz- 1 


(7.111) 
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Fig. 7.21 Comparison between discrete and continuous response. 

Hence the difference equation for the digital compensator is 

u(kT) = O.U\u(k - \)T + lA61e(kT) — 6.756e(k — l)T (7.112) 


7.7.2 Digital compensator design using pole placement 

Case study 

Example 7.8 (See also Appendix 1, examp78.m) 

The continuous control system shown in Figure 7.22(a) is to be replaced by the digital 

control system shown in Figure 7.22(b). 

(a) For the continuous system, find the value of K that gives the system a damping 
ratio of 0.5. Determine the closed-loop poles in the .v-plane and hence the values 
of a and w. 

(b) Find the closed-loop bandwidth and make the sampling frequency u s a factor 
of 10 higher. What is the value of T1 

(c) For the sampled system shown in Figure 7.22(b), find the open-loop pulse trans- 
fer function G{z ) when the sample and hold device is in cascade with the plant. 

(d) With D{z) set to the value of K found in (a), compare the continuous and discrete 
step responses. 
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(b) 


Fig. 7.22 Continuous and digital control systems. 

(e) By mapping the closed-loop poles from the s to the r-plane, design a compensator 
D(r) such that both continuous and sampled system have identical closed-loop 
response, i.e. £ = 0.5. 

Solution 

(a) The root-locus diagram for the continuous system in shown in Figure 7.23. From 
Figure 7.23 the closed-loop poles are 

s = — 0.5 =t j0.866 (7.113) 


or 


<t=— 0.5, u> = 0.866 rad/s 
and the value of K is 0.336. 

(b) Plotting the closed-loop frequency response for the continuous system gives a 
bandwidth tub of 1.29 rad/s(0. 205 FLz). The sampling frequency should therefore 
be a factor of 10 higher, i.e. 12.9rad/s(2.05FIz). Rounding down to 2.0 Hz gives 
a sampling time T of 0.5 seconds. 

“> G »= (1 -- ,)Z {?ccn)} 

Using transform 7 in Table 7.1 

3{(e-°- 5 -0.5)r + (l-1.5e-°- 5 )} 

W (z - l)(z - e-°- 5 ) 


(7-114) 
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Fig. 7.23 Root locus diagram for continuous system. 


Hence 


G(z) 


0.3196(r+ 0.8467) 
(z - l)(z - 0.6065) 


(7.115) 


(d) With D(z) = K = 0.336, the difference between the continuous and discrete step 
response can be seen in Figure 7.24. 

(e) Mapping closed-loop poles from s to z-plane 


r = e 


inserting values 


|z| = g— 0.5x0. 5 = 0 779 


(7.116) 


Lz = loT 

= 0.866 x 0.5 = 0.433 rad 
= 24.8° 


(7.117) 


Converting from polar to cartesian co-ordinates gives the closed-loop poles in the z- 
plane 

z = 0.707 ±j0.327 (7.118) 

which provides a z-plane characteristic equation 


z 2 - 1.414z + 0.607 = 0 


(7.119) 
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Fig. 7.24 Continuous and digital controllers set to K = 0.336. 


The control problem is to design a compensator D(z), which, when cascaded with 
G(z), provides a characteristic equation 

1 + D(z)G(z) = 0 (7.120) 

such that the equations (7.119) and (7.120) are identical. Let the compensator be of 
the form 


D(z) 


K(z — a) 
(z + b) 


Select the value of a so that the non-unity pole in G(z) is cancelled 


D(z)G(z) 


K(z- 0.6065) 0.3196(z + 0.8467) 
(z + b) (z- l)(r — 0.6065) 


Hence the characteristic equation (7.120) becomes 


0.3196*0: + 0.8467) 
(z + b)(z- 1) 


which simplifies to give 

z 2 + (0.3196* + b- l)z + (0.2706* - b) = 0 


(7.121) 


(7.122) 


(7.123) 
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Fig. 7.25 Identical continuous and discrete step responses as a result of pole placement. 


Equating coefficients in equations (7.119) and (7.123) gives 

0.3196.S: + 6- 1 = -1.414 (7.124) 

0.27067s: — b = 0.607 (7.125) 

Add 0.59027s: - 1 = -0.807 


or 

0.59027s: = 0.193 
K = 0.327 


Inserting equation (7.126) into (7.125) 

(0.2706 x 0.327) - 0.607 = b 
b = —0.519 


(7.126) 


(7.127) 


Thus the required compensator is 


„ , U , , 0.327(r - 0.6065) 

D(z) = — (z) = 

V; E ’ (z- 0.519) 


(7.128) 


Figure 7.25 shows that the continuous and discrete responses are identical, both with 
£ = 0.5. The control algorithm can be implemented as a difference equation 


U 

E 


0 ) 


0.327 


(1 - 0.6065z-‘) 
(1 -0.519Z- 1 ) 


(7.129) 


hence 


u(kT) = 0.327e(A'T) — 0.1983e(/r — l)T + 0.5l9u(k - 1 )T 


(7.130) 
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7.8 Further problems 


Example 7.9 

Assuming that a sample and hold device is in cascade with the transfer function G(s), 
determine GO) for the following 

(a) GO) = — , T = 0.1 seconds 
0 + 1 ) 


(b) GO) = 

(c) GO) = 


0 + DO + 2) 

1 

s(s + 0.5) ’ 


T = 0.5 seconds 
T = 1.0 seconds 


Solution 

(a) GO) 


0.095 
z- 0.905 


(b) GO) 


0.1550 + 0.606) 
z 2 - 0.974z + 0.223 


(c) GO) 


0.4260 + 0.847) 
z 2 - 1.607z + 0.607 


Example 7.10 

The computer control system shown in Figure 7.26 has a sampling time of 0.5 
seconds 

(a) Find the open-loop pulse transfer function GO) and hence determine the open- 
loop poles and zeros for the combined sample and hold and the plant. 

(b) From (a) evaluate the difference equation relating c(kT), c(k —1)7’, c{k — 2 )T, 
i i(k — 1)7’ and u(k — 2)7’. 

(c) If the computer has the control algorithm 

u(kT) = 1.5 e(kT) 



Fig. 7.26 Computer control system for Example 7.10. 
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using a tabular approach, calcuate the system response when the input is a unit 
step applied at kT = 0 for the discrete time values of k T = 0, 0.5, 1.0, 1.5, 2.0 and 
2.5 seconds. Assume that at kT less than zero, all values of input and output 
are zero. 


Solution 


(a) G(z) 


0.1419(z + 0.523) 
2 2 - 1.1352 + 0.135 


poles 2 = 1, 0.135 
zeros 2 = —0.523 


(b) c(kT) = 1.135c(A- 

(c) kT 0 0.5 

c(kT ) 0 0.213 


1 )T — 0.135c(7r — 2)T 

1.0 1.5 2.0 

0.521 0.752 0.889 


0.1419«(Jfc - l)T + 0.0743 u(k - 2 )T 

2.5 

0.959 


Example 7.11 

A unity feedback computer control system, has an open-loop pulse transfer function 

0.426^(2 + 0.847) 

■’ ~ 2 2 - 1.6072 + 0.607 

Determine the open-loop poles and zeros, the characteristic equation and break- 
away points. 

Using the Jury test, determine the value of K at the unit-circle crossover points. 
Find the radius and centre of the circular complex loci, and hence sketch the root 
locus in the 2 -plane. 

Solution 


(a) 

(b) 

(c) 


(a) poles 2=1, 0.607 
zeros 2 = —0.847 

2 2 + (0.4267s: - 1.607)2 + (0.361AT + 0.607) = 0 
breakaway points 2 = 0.795, —2.5 

(b) K= 1.06,47.9 

(c) radius = 1.607, centre = —0.847, 0 


Example 7.12 

A unity feedback continuous control system has a forward-path transfer function 


G(s) 


K 

s(s + 5) 


(a) Find the value of K to give the closed-loop system a damping ratio of 0.7. The 
above system is to be replaced by a discrete-time unity feedback control system 
with a forward-path transfer function 
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G(s) 



1 


5(5 +5) 


(b) If the sampling time is 0.2 seconds, determine the open-loop pulse transfer 
function. 

(c) The discrete-time system is to have the identical time response to the continuous 
system. What are the desired closed-loop poles and characteristic equations in 

(i) the 5-plane 

(ii) the z-plane 

(d) The discrete-time compensator is to take the form 


D(z) = 


K\ (z + a) 


(z + b) 

Find the values of K\ and b if a is selected to cancel the non-unity open-loop pole. 

Solution 
(a) K = 12.8 

,,,, 0.0147(1 + 0.718) 

<b) G(Z) = (.--IX.-- 0.368) 

(c) —2.48 ± j2.56, 5 2 + 55 + 12.8 = 0 

0.531 ±j0.298, r 2 - 1.062z + 0.371 =0 
(z - 0.368) 


(d) D(z) = 12.21 


(z - 0.242) 



8 


State-space methods for 
control system design 


8.1 The state-space-approach 

The classical control system design techniques discussed in Chapters 5-7 are gener- 
ally only applicable to 

(a) Single Input, Single Output (SISO) systems 

(b) Systems that are linear (or can be linearized) and are time invariant (have 
parameters that do not vary with time). 

The state-space approach is a generalized time-domain method for modelling, ana- 
lysing and designing a wide range of control systems and is particularly well suited to 
digital computational techniques. The approach can deal with 

(a) Multiple Input, Multiple Output (MIMO) systems, or multivariable systems 

(b) Non-linear and time-variant systems 

(c) Alternative controller design approaches. 


8.1.1 The concept of state 

The state of a system may be defined as: ‘The set of variables (called the state 
variables) which at some initial time t 0 , together with the input variables completely 
determine the behaviour of the system for time t > ?o’- 

The state variables are the smallest number of states that are required to describe 
the dynamic nature of the system, and it is not a necessary constraint that they are 
measurable. The manner in which the state variables change as a function of time 
may be thought of as a trajectory in n dimensional space, called the state-space. 
Two-dimensional state-space is sometimes referred to as the phase-plane when one 
state is the derivative of the other. 
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8.1.2 The state vector differential equation 

The state of a system is described by a set of first-order differential equations in terms 
of the state variables (x\, x 2 , ■ ■ ■ , x„) and input variables (u\, u 2 , ■ . . , u„) in the 
general form 

ci\\X\ + a n x2 + • • • + o\ n x n + b\\U\ + • • • + b\ m u m 

ci 2 \X\ + CI 22 X 2 ~\ f a 2 „x„ + b 2 \U\ -\ 1- b 2m u m (8.1) 

M n \X\ + Cl/j 2X2 T ‘ ‘ ‘ T ClnnXn ~\~ bn\U\ -(-***“(- b nmUm 

The equations set (8.1) may be combined in matrix format. This results in the state 
vector differential equation 


d.\'i 
dt 
d.\' 2 
dr 
dx„ 
d t 


x = Ax + Bu 


( 8 . 2 ) 


Equation (8.2) is generally called the state equation(s), where lower-case boldface 
represents vectors and upper-case boldface represents matrices. Thus 

x is the n dimensional state vector 


x\ 

X2 

X„ 

u is the m dimensional input vector 

u 1 

u 2 

_ 

A is the n x n system matrix 


a 11 

M\2 ■ 

• • Cl\ n 

«21 

022 • 

Clin 

Mul 

Mn 2 

. . Cl nn 


B is the n x m control matrix 


(8.3) 


(8.4) 


(8.5) 


bn • • • b\ m 

bl\ • • • t>2m 

bn 1 • • • b nm 


( 8 . 6 ) 
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m 



m 


I y-y-y 


(b) 


Fig. 8.1 Spring-mass-damper system and free-body diagram. 

In general, the outputs (ji, j 2 , • • - , y n ) of a linear system can be related to the state 
variables and the input variables 


y = Cx + Du 


(8.7) 


Equation (8.7) is called the output equation(s). 

Example 8.1 

Write down the state equation and output equation for the spring-mass-damper 
system shown in Figure 8.1(a). 

Solution 
State variables 


x\ = y 


( 8 . 8 ) 



(8.9) 


Input variable 


u = P(t) 


( 8 . 10 ) 


Now 


J2 F y = m y 


From Figure 8.1(b) 


P(t) — Ky — Cy = my 


or 



( 8 . 11 ) 
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From equations (8.9), (8.10) and (8.11) the set of first-order differential equations are 


Xl = X 2 

K C 1 

X2 = X\ X2 H U 

m m m 

and the state equations become 




' 0 

1 ' 




'O' 

X\ 





Xl 




= 

K 

C 



+ 

1 

X 2 





x 2 




m 

m. 


.in. 


From equation (8.8) the output equation is 


v = [l 


0 ] 


Xl 

Xl 


( 8 . 12 ) 


(8.13) 


(8.14) 


State variables are not unique, and may be selected to suit the problem being studied. 


Example 8.2 

For the RCL network shown in Figure 8.2, write down the state equations when 

(a) the state variables are v 2 (t) and v 2 

(b) the state variables are v 2 (t) and i(t). 


Solution 

(a) 


From equation (2.37) 


Xl = v 2 (t) 
x 2 = v 2 = Xl 


d 2 v-i dv 2 

LC d# + * C dF + V2 = VlW 


(8.15) 


(8.16) 


From equations (8.15) and (8.16) the set of first-order differential equations are 


ii = .x 2 


1 RC 

Xl = Xi x 2 

2 LC LC 


LC 


(8.17) 



Fig. 8.2 RCL network. 
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and the state equations are 


X\ 


' 0 

1 

1 " 

-R 

X\ 

+ 

' 0 ' 

1 

X2_ 


. LC 

L J 

. X 2_ 


lLc\ 


(b) *t = V2 (0 

X 2 = i(t) 


(8.18) 

(8.19) 


From equations (2.34) and (2.35) 


L J = -v 2 (t) - Ri{t) + x ’i{t) (8.20) 

dt A 

dvi 

c J = I(t) (8.21) 

Equations (8.20) and (8.21) are both first-order differential equations, and can be 
written in the form 


1 

x\ = ~^ x 2 

1 R 1 

X2 = ~ L x \ L x 2 4 ^ U 

giving the state equations 


X\ 


' 0 

1 

1 " 

R 

Xl 

+ 

'O' 

1 

x 2 _ 


,~L 

~L. 

. X 2_ 


_Z_ 


( 8 . 22 ) 


(8.23) 


Example 8.3 

For the 2 mass system shown in Figure 8.3, find the state and output equation when 
the state variables are the position and velocity of each mass. 


Solution 
State variables 

System outputs 
System inputs 


x\ = ji .\'2 = y\ 
*3 = J2 X 4 = y 2 

yi,yi 

ll = P(t ) 


For mass m\ 

^2 F y = m\y\ 

K 2 (y 2 - yi) - K m + P(t) - Cm = miyi 


(8.24) 


(8.25) 


For mass m 2 


22 F y = m 2 h 
- K 2 ( y 2 - yi) = m 2 y 2 


(8.26) 
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y n (0i 



km p ( f ) 



(a) (b) 

Fig. 8.3 Two-mass system and free-body diagrams. 

From (8.24), (8.25) and (8.26), the four first-order differential equations are 


X\ 

= ^2 




k 2 \ 

X 2 

_ 

— 


V m \ 


x 3 

= X4 



k 2 

k 2 

X'4 

= — Xi - 

x 3 


m 2 

m 2 


Ci 

X\ — > X 2 

m i 


K 2 1 

-X 3 -) u 

m i nr i 


(8.27) 


FLence the state equations are 


x\ 

X2 

x-i 

X4 


0 

Ki+K 2 

nil 

0 

K2 

m 2 


1 0 0 
C K 2 


ni\ m i 

0 0 


0 


K 2 

m 2 


and the output equations are 


yi 


1 

0 

0 

o' 

J’2 


0 

0 

1 

0 


X, 

-T2 

X 3 

X‘4 


r 1 


- 0 ‘ 

Xi 


l 

X 2 

+ 

— 

x 3 

X 4 

M\ 

0 



- 0 - 


(8.28) 


(8.29) 
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U(s) 


b n - 1 s n +••• + b-\S + bo 

Y(s) 

s" + a„_, s" '+■■■+ a^s+ a 0 



Fig. 8.4 Generalized transfer function. 


8.1.3 State equations from transfer functions 


Consider the general differential equation 

d "y d" _1 j dv , d n ~ l u d u 

d^ + an - 1 df^ + '" + ai dt + aoy = bn - l dr ZT+ "' + bl dt + boU 


(8.30) 


Equation (8.30) can be represented by the transfer function shown in Figure 8.4. 
Define a set of state variables such that 


Xi = X2 
Xi = X? 

(8.31) 


X„ = — Cl()X] — U\ A'2 — ... — a n _\X n + u 
and an output equation 

y = box i + b\X 2 H 1- b n -\x„ 

Then the state equation is 


Xl 


- 0 

1 

0 .. 

0 - 


Xl 


-O' 

X2 

— 

0 

0 

1 

0 


X2 

+ 

0 

X/i— 1 


0 

0 

0 .. 

1 


x „- 1 


0 

X„ 


.-no 

— 

— «2 • • 

^77—1 - 


X„ 


. 1 . 


(8.32) 


(8.33) 


The state-space representation in equation (8.33) is called the controllable canonical 
form and the output equation is 


y = [bo b i b 2 


Xl 

X2 


b n - 1] 


■^3 


(8.34) 


x n 


Example 8.4 (See also Appendix 1, examp84.m) 
Find the state and output equations for 


Y 

U 


(s) 


4 


5 3 + 3^ 2 + 6s + 2 


Solution 
State equation 
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Output equation 


X\ 


o 

o 


X\ 

X2 

= 

0 0 1 


X2 

X 3 _ 


-2 -6 — 3_ 


_ x 3 



•*1 


O 

o 

II 

*2 



*3 


Example 8.5 

Find the state and output equations for 


Y 5^ 2 + 7s + 4 

U s 3 + 3s 2 + 6s + 2 


(8.35) 


(8.36) 


Solution 

The state equation is the same as (8.35). The output equation is 


T = [4 7 


x\ 

5] x 2 

*3 


(8.37) 


8.2 Solution of the state vector differential equation 

Consider the first-order differential equation 

^ V = ax(t) + bu(t) (8.38) 

at 

where x(t) and u(t) are scalar functions of time. Take Laplace transforms 

sX(s) — x(0) = aX(s) + bU{s) (8.39) 

where x(0) is the initial condition. From equation (8.39) 

w = (7^ + <rV W (8401 

Inverse transform 

x(t) = e“'x(0) + f e fl(,_T) h«(r)dr (8.41) 

Jo 


where the integral term in equation (8.41) is the convolution integral and r is a 
dummy time variable. Note that 


= 1 


at - 


a 2 t 2 

2 ! 


a k t k 

TT 


(8.42) 
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Consider now the state vector differential equation 

x = Ax + Bu (8.43) 

Taking Laplace transforms 

sX(s) - x(0) = AX(s) + BU(j) (8.44) 


(H - A)X(,v) : x(0) + BL'(.v) 

Pre-multiplying by (.sT — A) -1 

X(s) = (si - Ar'x(O) + (si - A) _1 BU(j) (8.45) 

Inverse transform 

x(f) = e A, x(0) + f e A( '“ T, BU(r)dr (8.46) 

Jo 

if the initial time is to, then 

x(t) = e A(i -' o) x(0) + f e A( '- T) Bu(r)dr (8.47) 

Jto 

The exponential matrix e A ' in equation (8.46) is called the state-transition matrix 3>(t) 
and represents the natural response of the system. Hence 

0(s) = (d-Ar' (8.48) 


®(r) = JST^sI - A r 1 = e A ' (8.49) 

Alternatively 

A 2 1 2 K k t k 

®(t) = I + At + — +•••+— (8.50) 

Hence equation (8.46) can be written 

x(t) = ®(t)x(0) + / ®(t - r)Bu(r)dr (8.51) 

Jo 

In equation (8.51) the first term represents the response to a set of initial conditions, 
whilst the integral term represents the response to a forcing function. 

Characteristic equation 

Using a state variable representation of a system, the characteristic equation is given 
by 


\(sl - A)| = 0 


(8.52) 





' 0 

1 ' 




'O' 

X\ 





X\ 




= 

K 

C 



+ 

1 

X2 





X-2 



1 

m 

m. 

! I 

.771. 
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8.2.1 Transient solution from a set of initial conditions 

Example 8.6 

For the spring-mass-damper system given in Example 8.1, Figure 8.1, the state 
equations are shown in equation (8.13) 


(8.53) 


Given: m = 1 kg, C = 3 Ns/m, K = 2 N/m, u( t) = 0. Evaluate, 

(a) the characteristic equation, its roots, oj n and ( 

(b) the transition matrices <p(s) and <j>( t ) 

(c) the transient response of the state variables from the set of initial conditions 

y(0) = 1.0, 

j(0) = 0 

Solution 

Since x\ = y and X 2 = y, then x\ (0) = 1.0, X2(0) = 0. 

Inserting values of system parameters into equation (8.53) gives 


X\ 


r o n 

X\ 


'O' 

. . 


— i 

m 

<N 

1 

1 

. X 2_ 

+ 

1 


(a) 


(si - A) = 


s O' 


' 0 1 


'5 -1 

0 5 


-2 -3 


2 G + 3) 


From equation (8.52), the characteristic equation is 

| (si - A)| = s(s + 3) - (-2) = k 2 + 3s + 2 = 0 
Roots of characteristic equation 

s= -1, -2 


(8.54) 

(8.55) 

(8.56) 


Compare equation (8.55) with the denominator of the standard form in equation 
(3.43) 

w 2 = 2 i.e ui n = 1.414 rad/s 
2Cw n = 3 i.e C = 1-061 


(8.57) 


(b) The inverse of any matrix A (see equation A2.17) is 

Adjoint A 


A = ■ 


det A 


(8.58) 


From equation (8.48) 


<D (s) = (si - A)~ 
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Using the standard matrix operations given in Appendix 2, equation (A2.12) 

Minors of Ofs) = 


(s+3) 2 
-1 s 


(j + 3) -2 

1 5 


Co-factors of O(.v) = 

The Adjoint matrix is the transpose of the Co-factor matrix 

Adjoint of <B(.s) = 

Hence, from equations (8.58) and (8.48) 

(* + 3 ) 

<&(.?) = 


(s + 3) 1 
—2 s 


(s+l)(s + 2) (s+lXs + 2) 


- 2 


L(s+1)(s + 2) (s+1)(s + 2)J 

Using partial fraction expansions 

2 1 
S ~h 2 

1 

\ s T 1 s T 2 


4»U) = 


—2 


s+ 1 

1 


1 1 

.s' 4 1 s T 2 
1 2 
^ 4 1 s T 2 


Inverse transform equation (8.61) 


®(0 = 


(e 1 — e 2t ) 


(8.59) 


(8.60) 


(8.61) 


(8.62) 


' (2e~ r — e -2r ) 

— 2(e _; - e -2 ') (~e~‘ + 2e ~ 2r ) 

Note that the exponential indices are the roots of the characteristic equation (8.56). 
(c) From equation (8.51), the transient response is given by 


Hence 


x(0 = ®(f)x(0) 


X\ 


(2e 1 — e 2 ') (e ' — e 2 ') 

r 

x 2 _ 


— 2(e~' - e -2 ') (— e -r + 2e~ 2 ') _ 

0 


,\'i(0 = (2e ' - e 2 ') 
x 2 (t) = — 2(e - ' - e” 2r ) 


(8.63) 

(8.64) 

(8.65) 


The time response of the state variables (i.e. position and velocity) together with the 
state trajectory is given in Figure 8.5. 


Example 8.7 

For the spring-mass-damper system given in Example 8.6, evaluate the transient 
response of the state variables to a unit step input using 

(a) The convolution integral 

(b) Inverse Laplace transforms 

Assume zero initial conditions. 
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(b) 


Fig. 8.5 State variable time response and state trajectory for Example 8.4. 


Solution 

(a) From equation (8.51) 


x(0 = ®(0 


roi 


o 

+ l [ 


0 li(t-'r) 012 (t-r) 
021 (t-T) 022 (t-r) 


1 

'O' 


1 


_m . 


u(r)dr 


Given that u(t) = 1 and 1/m = 1, equation (8.66) reduces to 


x(t) = 

Inserting values from equation (8.62) 

x(l) = f 


r 

012(1- T) 

Jo 

. 022(1 - T) 


dr 


e -(t-r) _ e -2(l-r) 

e -(r— r) + 2 e ~ 2( ' _r) 


dr 


Integrating 


x(0 


q-O-t) _ i g— 2(1— r) 
e -(l-r) _|_ g— 2(1— r) 


Inserting integration limits (r = t and r = 0) 


Xl 


1 P -t _i_ 1 p-2 1 

2 c +2 C 

.*2. 


1 

<N 

1 

<D 

1 

T 

<D 

i 


( 8 . 66 ) 


(8.67) 


( 8 . 68 ) 


(8.69) 


(b) An alternative method is to inverse transform from an ^-domain expression. 
Equation (8.45) may be written 


X(s) = O(.v)x(0) + 0(.v)BU(.v) 


(8.70) 
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Fig. 8.6 State variable step response and state trajectory for Example 8.5. 


Hence from equation (8.61) 


X(J) = 3>(.v) 
Simplifying 


2 1 


1 1 


-2 


V 1 S -T 2 J \S +1 s 2 

1 1 \ / -1 2 


s -T 1 s -T 2 J \s +1 s -T 2 

1 1 f 2 


X(s) = 


.v(^+l) 2 ( 5 (^ + 2 ) 

-1 2 


y(y+l) 5(^ + 2) 


Inverse transform 


which gives 


(1 — e~ r ) — ^(1 -e~ 2r ) 
-(1 - e-') + (1 - e~ 2 ') 



°1 1 

1 y 


(8.71) 


(8.72) 


(8.73) 


(8.74) 


Equation (8.74) is the same as equation (8.69). 

The step response of the state variables, together with the state trajectory, is shown 
in Figure 8.6. 


8.3 Discrete-time solution of the state vector 
differential equation 

The discrete-time solution of the state equation may be considered to be the vector 
equivalent of the scalar difference equation method developed from a z-transform 
approach in Chapter 7. 
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The continuous-time solution of the state equation is given in equation (8.47). If 
the time interval ( t — to) in this equation is T , the sampling time of a discrete-time 
system, then the discrete-time solution of the state equation can be written as 


x[(A + 1)7”] = e AT x(kT) + 


e Ar Bdr \u(kT) 


(8.75) 


Equation (8.75) can be written in the general form 

x[(A- + 1 )T] = MT)x(kT) + H(T)u(kT) 


(8.76) 


Note 


A(7)/A and B(7) ^ B 

Equation (8.76) is called the matrix vector difference equation and can be used for the 
recursive discrete-time simulation of multivariable systems. 

The discrete-time state transition matrix A (T) may be computed by substituting 
T = t in equations (8.49) and (8.50), i.e. 

A(T) = ®{T) = e AT (8.77) 


or 


A (T) = 1 + AT + 


A 2 T 2 
2 ! 


A k T k 
k\ 


(8.78) 


Usually sufficient accuracy is obtained with 5 < k < 50. 

The discrete-time control matrix B(T) from equations (8.75) and (8.76) is 


B(T) = 



(8.79) 


or 


B(T) 


Put T within the brackets 



A k T k 

(ATT)! 


B7” 


Hence 


B( T) 


f ^kA k T k+l 

^TTn! 


B 


B(T) 



a 2 r 3 

~ n b 


k ’-pk + 1 


AT 


(A'+l)! 


>B 


(8.80) 


Example 8.8 (See also Appendix 1, examp88.m ) 

(a) Calculate the discrete-time transition and control matrices for the spring-mass- 
damper system in Example 8.6 using a sampling time T = 0.1 seconds. 

(b) Using the matrix vector difference equation method, determine the unit step 
response assuming zero initial conditions. 
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Solution 

(a) The exact value of A (T) is found by substituting T = t in equation (8.62) 


A (T) = 4>(T) 


(2e” 01 - e~ 0 - 2 ) (e~ 01 - e” 0 2 ) 
-2(e- 01 -e-°- 2 )(-e- 01 +2e- 0 - 2 ) 
' 0.991 0.086' 

-0.172 0.733 


(8.81) 


An approximate value of A (T) is found from equation (8.78), taking the series as far 
as k = 2. 


AT = 


0 

- 0.2 


0.1 

-0.3 


A 2 T 2 

' 0 

1 

' 0 1 ' 

0 . 1 2 

'-0.01 

-0.015' 

2! 

-2 

-3 

-2 -3 

1x2“ 

0.03 

0.035 


using the first 3 terms of equation (8.78) 


A (T) 


l 

' 0 

0.1 ' 

1 

'-0.01 

-0.015' 

+ 

—0.2 

-0.3. 

~r 

. 0.03 

0.035 . 


' 0.99 0.085' 

-0.17 0.735 


(8.82) 


Since in equation (8.66), m(t) is unity, the exact value of B(T) can be obtained by 
substituting T = t in equation (8.69) 


B(T) 

B(T) 


e — 0 . 1 _ e — 0.2 

'0.00453' 

0.0861 


(8.83) 

(8.84) 


An approximate value of B(T) is found from equation (8.80), taking the series as far 
as k = 2. 


/A T 2 \ /A 2 t 3 \ 

B(T) « (IDB + f B + ( — ) B 


0 ' 

I 

' 0.005 ' 

I 

'-0.0005' 

0.1. 

~r 

— 0.01 5 

~r 

. 0.00117 . 


' 0.0045 ' 
0.08617 


(8.85) 


(b) Using the values of A (T) and B(T) given in equations (8.81) and (8.84), together 
with the matrix vector difference equation (8.76), the first few recursive steps of 
the discrete solution to a step input to the system is given in equation (8.86) 
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kT = 0 

".\'i (0.1)1 _ [ 0.991 0.086] [0] [ 0.00453] _ [0.00453' 

x 2 (0.1)J “ [ —0.172 0.733 J [oj + [ 0.0861 J [ 0.0861 

kT = 0.1 

"a'j (0.2)] _ [ 0.991 0.086] [0.00453] [0.00453] _ [ 0.016 ' 

_x 2 (0.2)J “ [ —0.172 0.733 J [ 0.0861 J + [ 0.0861 J “ [ 0.0148 

kT = 0.2 

'xj(0.3)] _[ 0.991 0.086] [0.016] [0.00453] [0.033] 

x 2 (0.3)J “ [-0.172 0.733J [0.148j + [ 0.0861 j [0.192j ( ' 

AT = 0.3 

"a'j (0.4)] _ [ 0.991 0.086] [0.033] [0.00453] _ [0.054' 

x 2 (0.4)J “ [-0.172 0.733 J [ 0.192 J + [ 0.0861 J “ [o.227 

kT = 0.4 

xi(0.5)] _ [ 0.991 0.086] [0.054] [0.00453] _ [0.078' 

_x 2 (0.5)J " [-0.172 0.733 J [o.227 J + [ 0.0861 J “ [ 0.243 


Example 8.9 

A system has a transfer function 

I (J) = 1 

U' s 2 + 2s+l 

The system has an initial condition y(0) = 1 and is subject to a unit ramp function 
u(t) = t. Determine 

(a) The state and output equations 

(b) The transition matrix «&(.?) 

(c) Expressions for the time response of the state variables. 

Solution 





(b) 4>(.sj = 


5 + 2 1 

(5+ 1 )(5+ 1) (S + 1 )(S + 1 ) 
-1 5 

(5+ l)(.v+ 1) (s + 1 )(s + 1 ) 


(c) 


Xi 

X2 


3e ' + 2 te r - 2 + t 
2 te~ r + 1 — e _/ 
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8.4 Control of multivariable systems 
8.4.1 Controllability and observability 


The concepts of controllability and observability were introduced by Kalman (1960) 
and play an important role in the control of multivariable systems. 

A system is said to be controllable if a control vector u(?) exists that will transfer 
the system from any initial state x(t 0 ) to some final state x(?) in a finite time interval. 

A system is said to be observable if at time to, the system state x(?o) can be exactly 
determined from observation of the output y( t) over a finite time interval. 

If a system is described by equations (8.2) and (8.7) 


x = Ax + Bu 
y = Cx + Du 


(8.87) 


then a sufficient condition for complete state controllability is that the n x n matrix 


M = [B:AB:...:A" *B] 


( 8 . 88 ) 


contains n linearly independent row or column vectors, i.e. is of rank n (that is, the 
matrix is non-singular, i.e. the determinant is non-zero. See Appendix 2). Equation 
(8.88) is called the controllability matrix. 

The system described by equations (8.87) is completely observable if the n x n 
matrix 


N = 


C t :A t C t : 




(8.89) 


is of rank n, i.e. is non-singular having a non-zero determinant. Equation (8.89) is 
called the observability matrix. 


Example 8.10 (See also Appendix 1, examp810.m ) 

Is the following system completely controllable and observable? 


' x \ ' 

= 

' —2 

0 ' 

■*r 

+ 

T 

. 0 . 

,X2. 


_ 3 

-5. 

,X2. 




x 2 J 


Solution 

From equation (8.88) the controllability matrix is 


where 


hence 


M = [B:AB] 


AB = 


'-2 O' 

r 


'-2' 

3 -5 

0 


3 


M = [BAB] 


0 —2 
1 3 


(8.90) 
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Equation (8.90) is non-singular since it has a non-zero determinant. Also the two row 
and column vectors can be seen to be linearly independent, so it is of rank 2 and 
therefore the system is controllable. 

From equation (8.89) the observability matrix is 


where 


hence 


N = [C t :A t C t " 


r-2 3i 

l 


'-5' 

— i 

i n 

1 

O 

-l 


5 


N = [C t :A t C t 



(8.91) 


Equation (8.91) is singular since it has a zero determinant. Also the column vectors 
are linearly dependent since the second column is —5 times the first column and 
therefore the system is unobservable. 


8.4.2 State variable feedback design 


Consider a system described by the state and output equations 

x = Ax + Bu 
y = Cx 

Select a control law of the form 


(8.92) 


u = (r - Kx) (8.93) 

In equation (8.93), r (?) is a vector of desired state variables and K is referred to as the 
state feedback gain matrix. Equations (8.92) and (8.93) are represented in state 
variable block diagram form in Figure 8.7. 

Substituting equation (8.93) into equation (8.92) gives 


x = Ax + B(r - Kx) 


or 

x = (A - BK)x + Br (8.94) 

In equation (8.94) the matrix (A - BK) is the closed-loop system matrix. 

For the system described by equation (8.92), and using equation (8.52), the 
characteristic equation is given by 

| (si — A)| = 0 (8.95) 

The roots of equation (8.95) are the open-loop poles or eigenvalues. For the closed- 
loop system described by equation (8.94), the characteristic equation is 

|(sI-A + BK)| = 0 (8.96) 

The roots of equation (8.96) are the closed-loop poles or eigenvalues. 
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Fig. 8.7 Control using state variable feedback. 


Regulator design by pole placement 

The pole placement control problem is to determine a value of K that will produce 
a desired set of closed-loop poles. With a regulator, r(t) = 0 and therefore equation 
(8.93) becomes 

u = -Kx 

Thus the control u(t) will drive the system from a set of initial conditions x(0) to a set 
of zero states at time t\, i.e. x(?i) = 0. 

There are several methods that can be used for pole placement. 

(a) Direct comparison method : If the desired locations of the closed-loop poles 
(eigenvalues) are 

S = P\,S = P 2 , s = Hn (8.97) 

then, from equation (8.96) 

|.vl - A + BK| = {s - m){s - ij 2 ) ■ ■ ■ (s - Hn) (8.98) 

= s" + -I 1- a\s + ao (8.99) 

Solving equation (8.99) will give the elements of the state feedback matrix. 

(b) Controllable canonical form method : The value of K can be calculated directly using 

k = [ao — ao :ai — a 2 : . . .: a „~2 — a n -2 '-oi n -i — a n -i]T 1 (8.100) 

where T is a transformation matrix that transforms the system state equation into 
the controllable canonical form (see equation (8.33)). 


T = MW 


( 8 . 101 ) 
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where M is the controllability matrix, equation (8.88) 


a i «2 
ai a 3 


W 


a n 1 

1 


1 

0 


(l n — 1 1 

1 0 


0 0 
0 0 


( 8 . 102 ) 


Note that T = I when the system state equation is already in the controllable 
canonical form. 


(c) Ackermann’s formula-. As with Method 2, Ackermann’s formula (1972) is a direct 
evaluation method. It is only applicable to SISO systems and therefore u(t ) and 
y(t) in equation (8.87) are scalar quantities. Let 


K = [0 0 ... 0 1]M _1 0(A) (8.103) 

where M is the controllability matrix and 

<j>(A) = A" + a„_i A" -1 + • • • + ai A+ a 0 I (8.104) 

where A is the system matrix and a; are the coefficients of the desired closed-loop 
characteristic equation. 

Example 8.11 (See also Appendix 1, examp811.m ) 

A control system has an open-loop transfer function 

i ( 5 )= _l_ 

U KJ s(s + 4) 

When.Ti =yand .\'2 = x\, express the state equation in the controllable canonical form. 
Evaluate the coefficients of the state feedback gain matrix using: 

(a) The direct comparison method 

(b) The controllable canonical form method 

(c) Ackermann’s formula 

such that the closed-loop poles have the values 

5 = —2, s = —2 

Solution 

From the open-loop transfer function 

y + 4y = u (8.105) 

Let 

x\ =y (8.106) 

Then 


-Vl = X2 

X-2 = —4X2 + U 


(8.107) 
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Equation (8.106) provides the output equation and (8.107) the state equation 


ii] [0 1 1 U1 , [0 


xi\ 0 — 4 ,V2 1 


(8.108) 


J = [l 0] 


The characteristic equation for the open-loop system is 

, , r ^ 01 [0 11 , 

El - A = - = s 2 + 4s + 0 

1 1 [0 sj [0 -4j 

= s 2 + a\s + ciq 


(8.109) 


( 8 . 110 ) 


ci\ = 4, ciq = 0 

The required closed-loop characteristic equation is 

(s + 2)(s + 2) = 0 


s 2 + As + 4 = 0 


( 8 . 111 ) 


s 2 + a\s + ao = 0 


( 8 . 112 ) 


ai = 4, ao = 4 


(a) Direct comparison method: From equations (8.99) and (8.111) 


|sl — A + BK| = s 2 + 4s + 4 


(8.113) 


s o i ro i] r o i r , 

T [ Ai/v-7 1 =s +4.V + 4 

0 s 0-4 1 1 J 


s -ii r o o 


0 s + 4 I I k\ k. 


= sr + 4s + 4 


, , , = r + 4s + 4 

k\ s T 4 T /tt 

s 2 + (4 + k 2 )s + Aq = s 2 + 4s + 4 


(8.114) 


From equation (8.114) 


k\ = 4 

(4 + k 2 ) = 4 i.e. k 2 = 0 


(8.115) 
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(b) Controllable canonical form method: From equation (8.100) 

K = [a 0 — «o : ot\ — fli]T _1 
= [4 — 0:4 — 4]T 1 
= [4 0 ]T 1 

now 

I MW 


where 


M = [BAB] 


(8.116) 


giving 


AB = 


'0 

1 

O' 


1 

0 

-4 

1 


-4 


M 


0 

1 


1 

-4 


(8.117) 


Note that the determinant of M is non-zero, hence the system is controllable. 
From equation (8.102) 


FLence 


W = 


Cl\ 

r 


'4 

f 

1 

0 


1 

0 


T = MW = 


'0 

1 

'4 

r 


' i 

o' 

1 

-4 

1 

0 


0 

1 


= 1 


(8.118) 


Thus proving that equation (8.108) is already in the controllable canonical form. 
Since T _1 is also I, substitute (8.118) into (8.116) 

K = [4 0]I = [4 0] (8.119) 


(c) Ackermann’s formula : From (8.103) 

K = [0 1]M“V(A) 


From (8.1 17) 


AT 1 


1 

'-4 

-1 


'4 

f 

-1 

-1 

0 


1 

0 


( 8 . 120 ) 


( 8 . 121 ) 


From (8.104) 


<f>( A) = A" + a \ A + aol 
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inserting values 


<K A) 


0 

1 

2 

'0 1 


'1 O' 



+ 4 


+ 4 


0 

—4 


° -4 


° 1 


0 

-4" 

+ 

'0 

4 

+ 

'4 

O' 

0 

16 _ 


_0 

— 16 


_0 

4 


4 0 


0 4 


Insert equations (8.121) and (8.122) 


K = [0 


= [0 


into (8.120) 


1 ] 

1 ] 


4 1 
1 0 
16 4 
4 0 


O' 

4 


K = [4 0] 


( 8 . 122 ) 


(8.123) 


These results agree with the root locus diagram in Figure 5.9, where K = 4 produces 
two real roots of 5 = —2, s = — 2 (i.e. critical damping). 


8.4.3 State observers 


In section 8.4.2 where state feedback design was discussed, it was assumed that all the 
state variables were available for the control equation (8.93) for a regulator 

u = (r - Kx) 


when r = 0 


u=-Kx (8.124) 

Equations (8.124) requires that all state variables must be measured. In practice this 
may not happen for a number of reasons including cost, or that the state may not 
physically be measurable. Under these conditions it becomes necessary, if full state 
feedback is required, to observe, or estimate the state variables. 

A full-order state observer estimates all of the system state variables. If, however, 
some of the state variables are measured, it may only be necessary to estimate a few 
of them. This is referred to as a reduced-order state observer. All observers use some 
form of mathematical model to produce an estimate x of the actual state vector x. 
Figure 8.8 shows a simple arrangement of a full-order state observer. 

In Figure 8.8, since the observer dynamics will never exactly equal the system 
dynamics, this open-loop arrangement means that x and x will gradually diverge. If 
however, an output vector y is estimated and subtracted from the actual output 
vector y, the difference can be used, in a closed-loop sense, to modify the dynamics of 
the observer so that the output error (y — y) is minimized. This arrangement, some- 
times called a Luenberger observer (1964), is shown in Figure 8.9. 
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Fig. 8.8 A simple full-order state observer. 

Let the system in Figure 8.9 be defined by 

x = Ax + Bu (8.125) 

y = Cx (8.126) 

Assume that the estimate x of the state vector is 

x = Ax + Bu + K e (y — Cx) (8.127) 

where K e is the observer gain matrix. 

If equation (8. 127) is subtracted from (8. 125), and (x — x) is the error vector e, then 

e = (A — K e C)e (8.128) 

and, from equation (8.127), the equation for the full-order state observer is 

i = (A — K e C)x + Bu + K e y (8.129) 

Thus from equation (8.128) the dynamic behaviour of the error vector depends upon 
the eigenvalues of (A — K e C). As with any measurement system, these eigenvalues 
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Fig. 8.9 The Luenberger full-order state observer. 

should allow the observer transient response to be more rapid than the system itself 
(typically a factor of 5), unless a filtering effect is required. 

The problem of observer design is essentially the same as the regulator pole 
placement problem, and similar techniques may be used. 

(a) Direct comparison method. If the desired locations of the closed-loop poles 
(eigenvalues) of the observer are 

S = fJLi, S = P2, S = n„ 

then 

|>sl - A + K e C| = (.S’ - IM)(s - l-l 2 ) ■ ■ ■ (s - tin) 

= s n + oc n — i s n * + • • • + ags + cto 


(8.130) 
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(b) Observable canonical form method'. For the generalized transfer function shown 
in Figure 8.4, the observable form of the state equation may be written 


■*r 


'0 

0 .. 

.. 0 

*2 

— 

1 

0 .. 

.. 0 

_x n _ 


.0 

0 .. 

.. 1 


j = [0 0 ... 0 


— ao 
—a\ 


®n— 1 




'*r 


bo 


X2 

+ 

b\ 


Xn. 


. bn— 1 _ 


U 


X 


n J 


(8.131) 


Note that the system matrix of the observable canonical form is the transpose of the 
controllable canonical form given in equation (8.33). 

The value of the observer gain matrix K e can be calculated directly using 


K e = Q 


ao — Uq 
a\ — a\ 


t%n—l tl n — I 


(8.132) 


Q is a transformation matrix that transforms the system state equation into the 
observable canonical form 

Q = (WN T r‘ (8.133) 

where W is defined in equation (8.102) and N is the observability matrix given in 
equation (8.89). If the equation is in the observable canonical form then Q = I. 


(c) Ackermann’s formula'. As with regulator design, this is only applicable to systems 
where u(t) and y(t) are scalar quantities. It may be used to calculate the observer 
gain matrix as follows 


or alternatively 


K e = <^(A)N~ [0 0 ... 0 l] 7 


K e = <K A) 


c 

— I 

'O' 

CA 


0 

1 

0 

> .. 

3 

1 

1 


. 1 . 


(8.134) 


where <f>( A) is defined in equation (8.104). 


Example 8.12 (See also Appendix 1, examp812.m) 
A system is described by 


' Xi - 

= 

' 0 

1 ' 

' X\ ' 

+ 

'O' 

.1. 

_X 2 _ 


.-2 

-3. 

. X 2 _ 



v = [ 1 


0] 


x\ 

*2 
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Design a full-order observer that has an undamped natural frequency of 10 rad/s and 
a damping ratio of 0.5. 


Solution 

From equation (8.89), the observability matrix is 


N = 


C T : A t C t 


1 0 
0 1 


(8.135) 


N is of rank 2 and therefore non-singular, hence the system is completely observable 
and the calculation of an appropriate observer gain matrix K e realizable. 

Open-loop eigenvalues: 

|jl — A| = s 2 + 3s + 2 = s 2 + ais + ciq (8.136) 

Flence 


ciq — 2, ci\ — 3 


And the open-loop eigenvalues are 

5 2 + 3s + 2 = 0 
(s+ l)(s + 2) = 0 

s=- U s = —2 (8.137) 


Desired closed-loop eigenvalues: 

s 2 + 2Qjj n s + l u 2 = 0 

s 2 + 10.5 + 100 = s 2 + a i s + ao = 0 

Flence 

ao = 100 , a\ = 10 

and the desired closed-loop eigenvalues are the roots of equation (8.138) 
Hi = — 5 + j8.66, fi2 = — 5 — j 8 . 66 


(8.138) 


(8.139) 


(a) Direct comparison method. From equation (8.130) 

|^I — A + K e C| = s~ -f a\ -f ao 



0" 


' 0 1 ' 

+ 

l 

<D 

1 

0 

5 


-2 — 3_ 


|_ k e 2 J 


Is -1 ' 


ke\ 

o' 


+ 



|_2 s+3_ 


ke 2 

0_ 


s + k e i — 1 


2 + k e 2 5 + 3 


= 5 2 + 10.5 + 100 
= 5 2 + 10.5 + 100 
= 5 2 + 10.5 + 100 


5“ + (3 + k e \)s + (3k e \ + 2 + k e 2 ) — s + 10.5 + 100 


(8.140) 
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From equation (8.140) 

(3 + k e \) = 10, k e i = 7 


(3k e \ + 2 + k e 2 ) — 100 
k e 2 = 100 - 2 - 21 = 77 


(b) Observable canonical form method. From equation (8.132) 

Ke = Q 


= Q 
= Q 


ot 0 — do 

oil — Cl\ 

100-2 

10-3 

98 


Q = (WN 1 ) 


T\— 1 


Cl\ 

r 


'3 

r 

1 

0 


1 

0 


1 0 
0 1 


N 1 = 


1 0 
0 1 


From equation (8.133) 

and from equation (8.102) 

W 

Since from equation (8.135) 

N = 

Thus 

WN t = 

and 

Q = 


Since Q ^ I then A is not in the observable canonical form. 
From equation (8.143) 


'3 

r 

1 

o' 


'3 

r 

1 

0 

0 

1 


1 

0 


1 

' 0 

-1 


'0 

1 ' 

-1 

-1 

3 


1 

-3 


K e = 

(c) Ackermann’s Formula'. From (8.134) 

Ke = <K A) 


'0 

1 ' 

'98' 


' 7 ' 

1 

-3 

_ 7 _ 


11 _ 


C 

-1 

'O' 

CA 


1 


(8.141) 

(8.142) 


(8.143) 


(8.144) 


(8.145) 


(8.146) 


(8.147) 


(8.148) 
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Using the definition of 0(A) in equation (8.104) 


K e 


(A 2 


+ ol \ A + oqI) 


'1 

o' 

-1 

'o' 

0 

1 


1 


■ 

'-2 -3' 


' 0 

10 ' 


100 

0 ■ 

" 

'1 O' 

'O' 

Ke = 

.6 7 . 

+ 

.-20 

-30. 

+ 

0 

100. 


.0 1. 

.1. 


'98 

7 ' 

'1 

O' 

'O' 

. 14 

77. 

.0 

1 . 

. 1 . 

'98 

7 ' 

'O' 


■ 7 ' 

. 14 

77. 

. 1 . 


.77. 


(8.149) 


(8.150) 


8.4.4 Effect of a full-order state observer on a closed-loop 
system 

Figure 8.10 shows a closed-loop system that includes a full-order state observer. In 
Figure 8.10 the system equations are 

x = Ax + Bu 

y = Cx (8.151) 

The control is implemented using observed state variables 

u = — Kx (8.152) 

If the difference between the actual and observed state variables is 

e(t) = x(t) - x(0 

then 


i(r) = x(0-e(0 (8.153) 

Combining equations (8.151), (8.152) and (8.153) gives the closed-loop equations 

x = Ax — BK(x — e) 

= (A — BK)x + BKe (8.154) 


The observer error equation from equation (8.128) is 

e = (A - K e C)e 

Combining equations (8.154) and (8.155) gives 


A - BK BK 
0 A B e C 


(8.155) 


(8.156) 


Equation (8.156) describes the closed-loop dynamics of the observed state feedback 
control system and the characteristic equation is therefore 


|sIA + BK||jI- A + K e C| =0 


(8.157) 
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System 



Fig. 8.10 Closed-loop control system with full-order observer state feedback. 


Equation (8.157) shows that the desired closed-loop poles for the control system are 
not changed by the introduction of the state observer. Since the observer is normally 
designed to have a more rapid response than the control system with full order 
observed state feedback, the pole-placement roots will dominate. 

Using the state vectors x(t) and x(f) the state equations for the closed-loop system 
are 

From equations (8.151) and (8.152) 


x = Ax — BKx 


and from equation (8.129) 

i = (A — K e C)x - BKx + K e Cx 
= (A - K e C - BK)x + K e Cx 

Thus the closed-loop state equations are 

x 

X 



A 

— BK 

X 


K e C 

A - K e C - BK 

X 


(8.158) 


(8.159) 


(8.160) 
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8.4.5 Reduced-order state observers 


A full-order state observer estimates all state variables, irrespective of whether they 
are being measured. In practice, it would appear logical to use a combination of 
measured states from y = Cx and observed states (for those state variables that are 
either not being measured, or not being measured with sufficient accuracy). 

If the state vector is of /7th order and the measured output vector is of /nth order, 
then it is only necessary to design an (n — m)th order state observer. 

Consider the case of the measurement of a single state variable .\'i(t)- The output 
equation is therefore 

y = x i = Cx=[l 0 ... 0]x (8.161) 

Partition the state vector 


(8.162) 


where x e are the state variables to be observed. 
Partition the state equations 


Xl 

X e 


an Ai e 

A e i A ee 


X\ 

X2 


b i 

Be 


(8.163) 


If the desired eigenvalues for the reduced-order observer are 

S //■ 1 e ? S — • • • , S — l)e 

Then it can be shown that the characteristic equation for the reduced-order observer is 


1*^1 A ee K e Ai e | — (s l^le) ' • • l)e) 


= .V 


n— 1 


ji— 2 


+ Q!( ;I _2)e^ + ’ ’ ’ + QUe-S + CX 0 


(8.164) 


In equation (8.164) A ee replaces A and Ai e replaces C in the full-order observer. 

The reduced-order observer gain matrix K e can also be obtained using appropriate 
substitutions into equations mentioned earlier. For example, equation (8.132) 
becomes 


K e = Q e 


^oe ^oe 
G!le C l\ Q 


&(n— 2)e Q(n— 2)e 


(8.165) 


where a oe , ■ • • , fl(«-2)e are the coefficients of the open-loop reduced order character- 
istics equation 

|sl - A ee | = s" -1 + a ( „_ 2 )e^" -2 + Oi e ^ + a oe (8.166) 

and 


Qe = (WeNjr 1 


(8.167) 
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where 


W e = 


a\ 

a 2 ■ ■ 

■ ®n— 2 

1 

a 2 

«3 . 

.. 1 

0 

&n—2 

1 . 

.. 0 

0 

1 

0 . 

.. 0 

0 


and 


N e = 

and Ackermann’s formula becomes 

K e = 4>( A ee ) 


Aie : A ee TA} e : . . . : (A ee T)”~ 2 A} e 


-A le 

- 1 

'O' 



0 

Ale A”" 3 


0 

-AleA”" 2 . 


1 


where 


Define 


<j>( A ee ) — A” e 1 + Q;„_2A" e + • • • + 02 A ee + Ot\\ 


n—2 


Xei = X - K e V 


Then 

X = x e i - K e y 

The equation for the reduced-order observer can be shown to be 

Xei = (AeeK e Aie)Xel + {A e lK e flll + (A ee - K e Ai e )K e }y + (B e - K e hi)« 
Figure 8.11 shows the implementation of a reduced-order state observer. 


(8.168) 


(8.169) 


(8.170) 


(8.171) 


(8.172) 

(8.173) 


Case study 


Example 8.13 (See also Appendix 1, examp813.m ) 

(a) In case study Example 5.10 a control system has an open-loop transfer function 

G(s)H(s ) = 1 

s(s + 2 )(j + 5) 

The controller was a PD compensator of the form 

G(s) = K\ (5 + a) 

With ATi = 15 and a = 1, the system closed-loop poles were 


s= -3.132 ±j3.253 
s = -0.736 
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System 



Fig. 8.11 Implementation of a reduced-order state observer. 

with the resulting characteristic equation 

s 3 + Is 1 + 25s + 15 = 0 

Demonstrate that the same result can be achieved using state feedback methods. 

(b) Design a reduced second-order state observer for the system such that the poles 
are a factor of 10 higher than the closed-loop system poles, i.e. 

s = -31.32 ±j32.53 

which correspond to u> a = 45. 16 rad/s and ( = 0.7. 

Solution 

1 


(a) 


G(s)H(s) 


s 3 + 7s 2 + 10s + 0 
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From equations (8.33) and (8.34) 



'0| 

l 

o' 


' 0 " 

A = 

0 j 

0 

i 

B = 

0 


o; 

-10 

-7 


1 


C=[l 0 0] 


(8.174) 


Open-loop characteristic equation 

s 3 + 7s 2 + 10s + 0 = 0 
S 3 + Chs 1 + C1\S + Clo = 0 
Closed-loop characteristic equation 

s 3 + 7s 2 + 25s +15 = 0 
s 3 + a 2 s 2 + a\s + «o = 0 
Using direct comparison method 


(8.175) 


(8.176) 


|sl — A + BK| = s 3 + 7s 2 + 25s + 15 



to 

O 

o 


o 

0 

1 



o 

to 

o 

- 

0 0 1 

+ 


to 

o 

o 


_0 -10 -7 _ 



[ k i k 2 k 2 ] 



s 

-1 

0 


' 0 

0 

0 " 


0 

s 

-1 

+ 

0 

0 

0 


_0 

10 

s+7 _ 


_k\ 

k 2 h\ 



s 

-1 


0 



0 

s 


-1 


k\ 10 + k 2 s + 7 + k 2 


= s 3 + 7 s 2 + 25.v + 15 


= s 3 + 7s 2 + 25s + 15 


= s 3 + 7s 2 + 25s + 15 


Expanding the determinant in equation (8.177) gives 

k] = 15, k 2 = 15, k 2 = 0 

Hence 


(8.177) 


u = —[15 15 0] 


x\ 

x 2 

+3 


(8.178) 


since x 2 = x \ , this is identical to the original PD controller 

G(s) = 15 (s+ 1) 


Although the solution is the same, the important difference is with state feedback, the 
closed-loop poles are placed at directly the required locations. With root locus, a 
certain amount of trial and error in placing open-loop zeros was required to achieve 
the desired closed-loop locations. 
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(b) Reduced-order state observer. Partitioning the system equation A in (8.174) and 
inserting in equation (8.164) 


\s O' 


0 1 




— 


+ 


[° 


0 

1 

"xl 


. _ 


[1 0 ] 


Is -1 ' 



ol 


+ 



[lO s + l_ 


ke 2 

°J 


— S + 2 CjJJnS + 


= s 2 + 63.2^ + 2039.4 


— S + + OOe 


S + k e \ — 1 

10 + k e 2 s + 7 | 
s 2 + (7 + k el )s + (‘ 7k e i + 10 + k e2 ) — s 2 + 63.2 s + 2039.4 

Equating coefficients in equation (8.179) 

(7 + k e \) = 63.2 k e i = 56.2 


(8.179) 


(8.180) 


(7 x 56.2 + 10 + k e2 ) = 2039.4 


k e 2 = 1636 


Referring to Figure 8.11 and partitioned systems (8.174) and (8.163) 


B e — K e hi 
A e i — K e fln 
A ee K e Ai e 


'O' 


■ 56.2 ' 

0 = 

'O' 



. 1636 


. 1 . 

'O' 


' 56.2 ' 

0 = 

'O' 

.0 


1636 


.0 


0 1 ' 


■ 56.2 ' 

[1 

0] = 

' -56.2 1 ' 

1 

0 

1 


1636 

-1646 -7. 


(8.181) 


(8.182) 


Inserting equation (8.182) into Figure 8.11 gives the complete state feedback and 
reduced observer system shown in Figure 8.12. 

Comparing the system shown in Figure 8.12 with the original PD controller given 
in Example 5.10, the state feedback system may be considered to be a PD controller 
where the proportional term uses measured output variables and the derivative term 
uses observed state variables. 


8.5 Further problems 


Example 8.14 

For the d.c. motor shown in Figure 4.14, the potential difference across the armature 
winding is given by equation (4.21) 

e a (0 ~ e b (0 = C a + RJJ,t) 
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System 



Fig. 8.12 Complete state feedback and reduced observer system for case study Example 8.11. 
where, from equation (4.20) 


£>b(0 = Kb 


dO 
d t 


and the torque T m (t) developed by the motor is given by equation (4.18) 

T m (t) = KMt) 

If the load consists of a rotor of moment of inertia / and a damping device of 
damping coefficient C, then the load dynamics are 

where 0 is the angular displacement of the rotor. 
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(a) Determine the state and output equations when the state and control variables 
are 


A'l = 0, X2 = X\, Xt, = 4, u = e a 


(b) Determine the state and output equations when the state and control variables 
are 


X\ =6, X2 = X\ , 


X 3 = X 2 , u = e a 


Solution 

(a) 


Xl 

x 2 

i 3 


0 

0 

0 


1 

c 

7 

L a 


0 

K* 

I 

Ra 

~L a _ 




' 0 ' 

Xl 


0 

x 2 

+ 

1 

_x 3 _ 





X. 


(b) 


e = [\ o o]x 


Xl 

x 2 

X3 


'0 

0 

0 - 


e = [\ o o]x 


l 

o 

(K a K b + R a C) 
LJ 





r o i 

X, 


0 

x 2 

x 3 

+ 

K a 



lull 


Example 8.15 

Find the state and output equations for the positional servomechanism shown in 
Figure 8.13 when the state and control variable are 

x\ = c(t), x 2 = xi, u = r(t) 

Solution 




' 0 

i ■ 




'O' 

Xl 



Xl 



= 

K 

c 



+ 

K 

x 2 


— 

— 


_ x 2 _ 


— 



m 

m. 




_ m _ 


c = [ 1 0]x 



Fig. 8.13 Block diagram of positional servomechanism. 
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Example 8.16 

Find the state and output equations for the closed-loop control system shown in 
Figure 8.14 when the state and control variables are 

X\ = c(t), X2 = X ) , X3 = i'2, u = r(t) 

Solution 


X\ 


0 

1 

0 ' 


~Xi~ 


'O' 

X 2 

= 

0 

0 

1 


X2 

+ 

0 

X 3 


-640 

-192 

18 


*3 


1 


c=[ 640 160 0]x 

Example 8.17 

Figure 8.15 shows the block diagram representation of a car cruise control system 
where U(s ) is the desired speed, X(s) is the accelerator position and V(s) is the actual 
speed. 

(a) Find the state and output equations when the state and control variables are 

Xi = x(t), X2 = v(0, u = u(t) 

(b) Determine the continuous-time state transition matrix O(r). 

(c) For a sampling time of 0.1 seconds, evaluate from <£>(/) the discrete-time state 
transition matrix A (T). 


Accelerator Servo Vehicle Dynamics 



Fig. 8.15 Car cruise control system. 
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(d) Using the first three terms of equation (8.80), compute the discrete-time control 
transition matrix B(7). Using the difference equations 

x(k +1)7’ = A(T)x(kT) + Bu (kT) 

determine values for the state variables when u(kT) is a piece-wise constant 
function of the form 


kT (sec) 0 0.1 0.2 0.3 0.4 

u(k-T) 10 15 20 25 30 


Assume zero initial conditions. 


Solution 


(a) 


■U 


1 

bo 

o 

'2' 

+ 2 _ 


3 -3 J 

0 


v = [0 1 ]x 


(b) 

(c) 

(d) 


®(0 = 
A (T) = 
B (T) = 


e 2t 0 

3(— e -3 ' + e~ 2 ') e" 3 ' 

'0.819 0 

0.234 0.741 

'0.181' 

0.025 


kT (sec) 

0 

0.1 

0.2 

0.3 

0.4 

u(kT ) 

10 

15 

20 

25 

30 

Xl 

0 

1.81 

4.197 

7.057 

10.305 

X2 

0 

0.25 

0.984 

2.211 

3.915 


Example 8.18 

The ship roll stabilization system given in case-study Example 5.11 has a forward- 
path transfer function 




(s) 


K 

(s + l)U 2 + 0.7^ + 2) 


(a) For the condition K = 1, find the state and output equations when 
-U = 4> a (t), X 2 = x\, ,\'3 = X 2 and u = 6 d (t). 

(b) Calculate the controllability matrix M and the observability matrix N and 
demonstrate that the system is fully controllable and fully observable. 

(c) Determine the state feedback gain matrix K that produces a set of desired closed- 
loop poles 


5= -3.234 ±j3. 3 
5 = - 3.2 
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(d) Find the observer gain matrix K e for a full-order state observer that produces a 
set of desired closed-loop poles 

j= -16.15 ±jl6.5 
s= -16 


(e) If output 0 a (0 = x\ is measured, design a reduced-order state observer with 
desired closed-loop poles 

s= —16.15 ± jl6.5 


Solution 



Xi 


' 0 

1 

0 


Xl 


'O' 

(a) 

X2 

= 

0 

0 

1 


X2 

+ 

0 


*3 


-2 

-2.7 

-1.7 


X3 


1 


0 fl = [l 0 0]x 


(b) M = 


0 

0 

1 


0 1 
1 -1.7 

-1.7 0.19 


det(M) = — 1 , rank(M) = 3 
System fully controllable. 


N = 


1 0 0 
0 1 0 
0 0 1 


det(N) = 1 , rank(N) = 3 
System fully observable. 

(c) K = [66.29 39.34 7.968] 

(d) K e = [8527.2 1047.2 46.6] 

(e) K e = [530.3 30.6] 



9 


Optimal and robust control 
system design 


9.1 Review of optimal control 

An optimal control system seeks to maximize the return from a system for the 
minimum cost. In general terms, the optimal control problem is to find a control u 
which causes the system 

x = g(x(Y), u(t), t) (9.1) 

to follow an optimal trajectory x(t) that minimizes the performance criterion, or cost 
function 

J= j ' h(x(t), u(/), t)dt (9.2) 

•I to 

The problem is one of constrained functional minimization, and has several 
approaches. 

Variational calculus, Dreyfus (1962), may be employed to obtain a set of differ- 
ential equations with certain boundary condition properties, known as the Euler- 
Lagrange equations. The maximum principle of Pontryagin (1962) can also be 
applied to provide the same boundary conditions by using a Hamiltonian function. 

An alternative procedure is the dynamic programming method of Bellman (1957) 
which is based on the principle of optimality and the imbedding approach. The 
principle of optimality yields the Hamilton-Jacobi partial differential equation, 
whose solution results in an optimal control policy. Euler-Lagrange and Pontrya- 
gin’s equations are applicable to systems with non-linear, time-varying state equa- 
tions and non-quadratic, time varying performance criteria. The Hamilton-Jacobi 
equation is usually solved for the important and special case of the linear time- 
invariant plant with quadratic performance criterion (called the performance index), 
which takes the form of the matrix Riccati (1724) equation. This produces an optimal 
control law as a linear function of the state vector components which is always stable, 
providing the system is controllable. 


9.1.1 Types of optimal control problems 

(a) The terminal control problem : This is used to bring the system as close as possible 
to a given terminal state within a given period of time. An example is an 
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automatic aircraft landing system, whereby the optimum control policy will focus 
on minimizing errors in the state vector at the point of landing. 

(b) The minimum-time control problem : This is used to reach the terminal state in the 
shortest possible time period. This usually results in a ‘bang-bang’ control policy 
whereby the control is set to u max initially, switching to u m ; n at some specific time. 
In the case of a car journey, this is the equivalent of the driver keeping his foot 
flat down on the accelerator for the entire journey, except at the terminal point, 
when he brakes as hard as possible. 

(c) The minimum energy control problem'. This is used to transfer the system from an 
initial state to a final state with minimum expenditure of control energy. Used in 
satellite control. 

(d) The regulator control problem'. With the system initially displaced from equilib- 
rium, will return the system to the equilibrium state in such a manner so as to 
minimize a given performance index. 

(e) The tracking control problem'. This is used to cause the state of a system to track 
as close as possible some desired state time history in such a manner so as to 
minimize a given performance index. This is the generalization of the regulator 
control problem. 


9.1.2 Selection of performance index 

The decision on the type of performance index to be selected depends upon the 
nature of the control problem. Consider the design of an autopilot for a racing yacth. 

Conventionally, the autopilot is designed for course-keeping, that is to minimise 
the error ip e (t) between that desired course ipd{t) and the actual course ip a (t) in the 
presence of disturbances (wind, waves and current). Since ipd(t) is fixed for most of 
the time, this is in essence a regulator problem. 

Using classical design techniques, the autopilot will be tuned to return the vessel on 
the desired course within the minimum transient period. With an optimal control 
strategy, a wider view is taken. The objective is to win the race, which means 
completing it in the shortest possible time. This in turn requires: 

(a) Minimizing the distance off-track, or cross-track error y e (t). Wandering off track 
will increase distance travelled and hence time taken. 

(b) Minimizing course or heading error ip e (t). It is possible of course to have zero 
heading error but still be off-track. 

(c) Minimizing rudder activity, i.e. actual rudder angle (as distinct from desired 
rudder angle) 8 a (t), and hence minimizing the expenditure of control energy. 

(d) Minimizing forward speed loss u e (t). As the vessel yaws as a result of correcting 
a track or heading error, there is an increased angle of attack of the total velocity 
vector, which results in increased drag and therefore increased forward speed 
loss. 

From equation (9.2) a general performance index could be written 

J = f h{y e (t), ip e (t), u e (t), 8 a (t))dt 
J to 


(9.3) 
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Quadratic performance indices 

If, in the racing yacht example, the following state and control variables are defined 
*1 = y e (t), x 2 = ip e (t), * 3 = u e (t), u = 6 a (t) 
then the performance index could be expressed 

J= I {(4n*i + 422*2 + 433*3) + (/itt)}d? (9.4) 

J to 


or 

J= /'(Qx + Ru)d t (9.5) 

J to 

If the state and control variables in equations (9.4) and (9.5) are squared, then the 
performance index become quadratic. The advantage of a quadratic performance 
index is that for a linear system it has a mathematical solution that yields a linear 
control law of the form 

u(0 = — Kx(t) (9.6) 

A quadratic performance index for this example is therefore 

J = f { (411*1 + 422*2 + <733*3) + (rm 2 ) }dt (9.7) 

Jto 


f*' 


4n 

0 

0 ' 


*1 



[ *1 *2 * 3 ] 

0 

422 

0 


*2 

+ [«][n]M 

'to 


_ 0 

0 

433 _ 


_*3 _ 



or, in general 



u T Ru)dt 


(9.8) 


Q and R are the state and control weighting matrices and are always square and 
symmetric. J is always a scalar quantity. 


9.2 The Linear Quadratic Regulator 

The Linear Quadratic Regulator (LQR) provides an optimal control law for a linear 
system with a quadratic performance index. 


9.2.1 Continuous form 

Define a functional equation of the form 


7?(x, u)d? 


/ (x, t) = min 


(9.9) 
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where over the time interval to to t \ , 

/(x, to) =/(x(0)) 

/(x, ?i) = 0 

From equations (9.1) and (9.2), a FLamilton-Jacobi equation may be expressed as 


Of 

dt 


= —mm 


h(x, u) + 


Of 

dx 


g(x, u) 


For a linear, time invariant plant, equation (9.1) becomes 

x = Ax + Bu 

And if equation (9.2) is a quadratic performance index 

I 't\ 

/ = / (x t Qx + u T Ru)dt 

J to 

Substituting equations (9.11) and (9.12) into (9.10) 


Of 

dt 


= —nun 


df 

x'Qx + u'Ru+ ( -f ) (Ax + Bu) 
ox 


Introducing a relationship of the form 

/(x,0 = x T Px 

where P is a square, symmetric matrix, then 


dj - = x 
dt dt 


jd Px 


and 


Of 

dx 


= 2Px 


(9.10) 


(9.11) 


(9.12) 


(9.13) 


(9.14) 


(9.15) 


Of 

dx 


= 2x‘P 


Inserting equations (9.15) and (9.16) into (9.13) gives 

OP 

x T — x = —min |x T Qx + u T Ru + 2x T P(Ax + Bu)l 
dt u L J 

To minimize u, from equation (9.17) 

0[0f/dt\ 


da 


= 2u R + 2x PB = 0 


Equation (9.18) can be re-arranged to give the optimal control law 


(9.16) 


(9.17) 


(9.18) 


u 0 pt = -R B t Px 


(9.19) 
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or 

u opt = -Kx (9.20) 

where 

K = R ! B t P (9.21) 

Substituting equation (9.19) back into (9.17) gives 

x T Px = -x T (Q + 2PA - PBR 1 B t P)x (9.22) 

since 

2x t PAx = x t (A t P + PA)x 

then 

P= -PA - A t P-Q + PBR~ 1 B t P (9.23) 

Equation (9.23) belongs to a class of non-linear differential equations known as the 
matrix Riccati equations. The coefficients of P(?) are found by integration in reverse 
time starting with the boundary condition 

x T (h)P(h)x(ti) = 0 (9.24) 

Kalman demonstrated that as integration in reverse time proceeds, the solutions of 
P(0 converge to constant values. Should t\ be infinite, or far removed from t 0 , the 
matrix Riccati equations reduce to a set of simultaneous equations 

PA + A t P + Q -PBR 'B t P = 0 (9.25) 

Equations (9.23) and (9.25) are the continuous solution of the matrix Riccati 
equation. 

9.2.2 Discrete form 

From equation (8.76) the discrete solution of the state equation is 

x[(/c + 1 )T] = MT)x(kT) + B( T)u(kT) (9.26) 

For simplicity, if ( kT ) is written as (k), then 

x(k + 1) = A (T)x(k) + B(T)u(k) (9.27) 

The discrete quadratic performance index is 

N - 1 

J = (x T (k)Qx(k) + u T (k)Ru(k))T (9.28) 

k= 0 

The discrete solution of the matrix Riccati equation solves recursively for K and P in 
reverse time, commencing at the terminal time, where 

K (N - (A- + 1)) = [TR + B t (T)P( 7V - AjB(T)] 'B T (r)P(/V - k)A(T) (9.29) 
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and 

P(A - (k + 1)) = [TQ + K t (N ~(k+ l))TKK(N - (k + 1))] + [A (T) 

- B( T)K(N ~(k + 1))] T P(A - k)[A(T) - B(T)K{N - (k + 1))] 

(9.30) 

As k is increased from 0 to N — 1, the algorithm proceeds in reverse time. When run 
in forward-time, the optimal control at step k is 

u opt (k) = ~K(k)x(k) (9.31) 

The boundary condition is specified at the terminal time ( k = 0), where 

x J (N)P(N)x(N) = 0 (9.32) 

The reverse-time recursive process can commence with P(/V) = 0 or alternatively, 
with P(N — 1) = TQ. 


Example 9.1 (See also Appendix 1, examp91.m ) 

The regulator shown in Figure 9.1 contains a plant that is described by 


■xr 


' 0 

l ' 

' x\ ' 

M. 


-l 

-2. 

,X2. 


T=[l 0]x 


'O' 

1 


u 


and has a performance index 


/*oo 

T 

'2 

O' 

2 

L 

x A 

0 

1 

X + U 


Determine 


(a) the Riccati matrix P 

(b) the state feedback matrix K 

(c) the closed-loop eigenvalues 



Fig. 9.1 Optimal regulator. 
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Solution 

(a) 


A = 

Q = 


o 1 
-1 -2 
2 O' 

0 1 


B = 


0 

1 


R = scalar = 1 


From equation (9.25) the reduced Riccati equation is 

PA + A t P + Q - PBR *B t P = 0 


>11 

P 12' 

■ 0 

1 ■ 


' P\2 

P 11 

- 2pi 2 ’ 

.P2\ 

P22. 

-1 

— 2_ 


~P22 

P21 

— lp 2 2 _ 


(9.33) 

(9.34) 


'o -r 

>n 

Pi 2 ' 


P21 

P22 

. 1 -2. 

-P2\ 

P22 _ 


pn - 2 Pl l 

Pi 2 - 2p 2 2. 


(9.35) 


PBR-'B t P = 


Pi 1 

Pl2 

0 

P21 

P22_ 

1 

Pl2 



P22 _ 

[P21 

P22.\ 

P12P21 P12P22 

P22P21 p\ 2 


1[0 


P 11 

P 12 

P21 

P22 


Combining equations (9.34), (9.35) and (9.36) gives 


~Pi 2 Pn-2pi2 
P 22 P 21 — 2^22 


~P 21 P 22 

Pi 1 2/? 2 i Pl2-2p 2 2 


1 

O 

<N 


P 12 P 21 

P 12 P 22 

0 !. 


P 22 P 21 

PI 2 . 


(9.36) 


(9.37) 


Since P is symmetric, P 21 = pn- Equation (9.37) can be expressed as four simultan- 
eous equations 

~P\2 ~ P\2 + 2 — p\ 2 = 0 (9.38) 


Pi 1 - 2pn -P 22 -P 12 P 22 = 0 


(9.39) 
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~P22 +P 11 - 2 P\2 - P\2P22 = 0 


P 12 - 2P22 + P\2 ~ —P22 + 1 ~P\ 2 = 0 

Note that equations (9.39) and (9.40) are the same. From equation (9.38) 


solving 


Using positive value 


From equation (9.41) 


solving 


Using positive value 


From equation (9.39) 


Pu + 2 Pn -2 = 0 

7^12 = P 21 = 0.732 and -2.732 

P 12 = Pi\ = 0.732 

2p n - 4p 2 2 + 1 - ^22 = 0 
pl 2 + 4 P22 - 2.464 = 0 

P 22 = 0.542 and —4.542 

p 22 = 0.542 


pu - (2 x 0.732)— 0.542 - (0.732 x 0.542) = 0 
pu =2.403 

From equations (9.42), (9.43) and (9.44) the Riccati matrix is 


2.403 0.732 
0.732 0.542 


(b) Equation (9.21) gives the state feedback matrix 


K = R~'B t P=1[0 1] 


2.403 0.732 
0.732 0.542 


Hence 


K = [0.732 0.542] 
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(c) From equation (8.96), the closed-loop eigenvalues are 


s 0 

0 5 


|,yl - A + BK| 


0 1 
-1 —2 


[0.732 0.542] 


\s -1 ' 


0 

0 1 


+ 



|_ 1 i + 2_ 


0.732 

0.542 J 


-1 


| 1.732 5 + 2.542 | 
s 2 + 2.542.y + 1.732 


0 

0 

0 

0 

0 


si,s 2 = -1.271 ±j0.341 


In general, for a second-order system, when Q is a diagonal matrix and R is a scalar 
quantity, the elements of the Riccati matrix P are 


P ii = 


P12P22 ~ P22C121 ~ Pi 2®22 


P 12 = P 21 = 


/ 2 , 9ub\ 

Ch\ ± \l Qjl -I 7^ 


(9.47) 


P 22 = 


022 ± t / aL + 


(2pn + < 722 ) 


9.3 The linear quadratic tracking problem 

The tracking or servomechanism problem is defined in section 9. 1 .1(e), and is directed 
at applying a control u(?) to drive a plant so that the state vector x(f) follows a desired 
state trajectory r(t) in some optimal manner. 


9.3.1 Continuous form 

The quadratic performance index to be minimized is 

rh 

J= [(r — x) T Q(r — x) + u T Ru] dt (9.48) 

j to 

It can be shown that the constrained functional minimization of equation (9.48) 
yields again the matrix Riccati equations (9.23) and (9.25) obtained for the LQR, 
combined with the additional set of reverse-time state tracking equations 

s = (A - BR ‘B t P) t s - Qr 


(9.49) 
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Optimal Controller 


Plant 



Fig. 9.2 Optimal tracking system. 

where s is a tracking vector, whose boundary condition is 

s(h) = 0 (9.50) 

and the optimal control law is given by 

u opt = -R 'B t Px - R 'B t s 


If 


v = — R *B t s 


and 


K = R 'B t P 


Then 


u 0 pt = v — Kx (9.51) 

Hence, if the desired state vector r (t) is known in advance, tracking errors may be 
reduced by allowing the system to follow a command vector v(t) computed in 
advance using the reverse-time equation (9.49). An optimal controller for a tracking 
system is shown in Figure 9.2. 


9.3.2 Discrete form 

The discrete quadratic performance index, writing (kT) as ( k ), is 

N - 1 

J = J2 M k ) - x(£)) T Q(r(k) - x(k)) + u T (k)Ru(k )] T (9.52) 

k= 0 

Discrete minimization gives the recursive Riccati equations (9.29) and (9.30). These 
are run in reverse-time together with the discrete reverse-time state tracking equation 

s(N - (k + 1)) = F(7>(A -k) + G(T)r(N - k) (9.53) 
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having the boundary condition 

s (AO = 0 

F(T) and G(T) are the discrete transition and control matrices and are obtained by 
converting the matrices in the continuous equation (9.49) into discrete form using 
equations (8.78) and (8.80). 

The command vector v is given by 

\(N - k) = -R l B T s(N - k) (9.54) 

When run in forward-time, the optimal control at time ( kT ) is 

u opt (£T) = y(kT) - K(kT)x{kT) (9.55) 

The values of x(kT) are calculated using the plant state transition equation 

x(/c + \)T = A(T)x(kT) + B( T)u opt (kT) (9.56) 


Example 9.2 (See also Appendix 1, examp92.m) 

The optimal tracking system shown in Figure 9.2 contains a plant that is described by 



' 0 


1 1 ’ 


-i 

- 

-lj . 


i 

O' 

'xi ' 

y = 

.0 

1. 

.X2_ 


'O' 

1 


u 


The discrete performance index is 


200 




ir=0 


(r i (k T) - xi(kT))(r 2 (kT) - x 2 (kT )) 


10 0 
0 1 


r\{kT) — xi(kT) 
r 2 (kT) - x 2 (kT) J 


u(kT) 1 


It is required that the system tracks the following desired state vector 


{kT) 


' 1.0 sin (0. 6284k T) 

r 2 {kT)_ 


0.6cos(0.6284kT) 


over a period of 0-20 seconds. The sampling time T is 0.1 seconds. 

In reverse-time, starting with P(.V) = 0 at NT = 20 seconds, compute the state 
feedback gain matrix K {kT) and Riccati matrix P(kT) using equations (9.29) and 
(9.30). Also in reverse time, use the desired state vector r (kT) to drive the tracking 
equation (9.53) with the boundary condition s (N) = 0 and hence compute the com- 
mand vector \(kT). 

In forward-time, use the command vector \(kT) and state vector x(kT) to calculate 
Uopt(A’T) in equation (9.55) and hence, using the plant state transition equation (9.56) 
calculate the state trajectories. 
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Solution 

The reverse-time calculations are shown in Figure 9.3. Using equations (9.29) and 
(9.30) and commencing with P(iV) = 0, it can be seen that the solution for K (and also 
P) settle down after about 2 seconds to give steady-state values of 


K(kT) 
P (kT) 


[2.0658 1.4880] 
'8.0518 2.3145' 
2.3145 1.6310 


(9.57) 


Using equation (9.49), together with equations (8.78) and (8.80), to calculate F(T) 
and G{T) in equation (9.53), for T = 0.1 seconds, the discrete reverse-time state 
tracking equation is 


'*!(#-(*+ 1))' 


'0.9859 

-0.2700' 

si(N — k) 

_.s 2 (N — (k + 1))_ 


0.0881 

0.7668 _ 

s 2 (N — k) 


'-0.9952 

0.0141 ' 

r\(N -k) 

-0.0460 

-0.0881 _ 

r 2 (N — k ) 


and 


\(N 


k) = - 1 [ 0 


[ si(N - k) 
J s 2 (N-k ) 


(9.58) 


Then the command vector v (in this case a scalar) is generated in reverse-time as 
shown in Figure 9.3. The forward-time response is shown in Figure 9.4. 
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Fig. 9.3 Reverse-time solutions for a tracking system. 
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Fig. 9.4 Forward-time response of a tracking system. 


The optimal control is calculated using equation (9.55) and the values of the state 
variables are found using the plant state transition equation (9.56) 


~x l (k + \)T 


' 0.9952 

0.0950' 

*i (kT) 

1 

'0.0048' 

x 2 (k + \)T 


-0.0950 

0.9002 _ 

x 2 (kT) 

~r 

_0.0950_ 


u op i(k T) 


(9.59) 


where A (T) and B (T) are calculated from equations (8.78) and (8.80). From Figure 
9.4 it can be seen that after an initial transient period, the optimal control law takes 
the form of a phase lead compensator. Because of the weighting of the Q matrix in 
the performance index, x\(kT) tracks r\(kT) more closely than X 2 (kT) tracks r 2 (kT). 


9.4 The Kalman filter 


In the design of state observers in section 8.4.3, it was assumed that the measure- 
ments y = Cx were noise free. In practice, this is not usually the case and therefore 
the observed state vector x may also be contaminated with noise. 


9.4.1 The state estimation process 

State estimation is the process of extracting a best estimate of a variable from a 
number of measurements that contain noise. 

The classical problem of obtaining a best estimate of a signal by combining two 
noisy continuous measurements of the same signal was first solved by Weiner (1949). 
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His solution required that both the signal and noise be modelled as random process 
with known statistical properties. 

This work was extended by Kalman and Bucy (1961) who designed a state 
estimation process based upon an optimal minimum variance filter, generally 
referred to as a Kalman filter. 


9.4.2 The Kalman filter single variable estimation problem 

The Kalman filter is a complementary form of the Weiner filter. Let A x be a 
measurement of a parameter x and let its variance P a be given by 

P a = v{{A x -A x f} (9.60) 

where A x is the mean and E{ } is the expected value. 

Let B x be a measurement from another system of the same parameter and the 
variance P ' b is 


P b = E{(B X - B x ) 2 } (9.61) 

Assume that x can be expressed by the parametric relationship 

x = A X K + B x {\ - K) (9.62) 

where K is any weighting factor between 0 and 1 . The problem is to derive a value of 
K which gives an optimal combination of A x and B x and hence the best estimate of 
measured variable x, which is given the symbol x (pronounced x hat). 

Let P be the variance of the weighted mean 


P = E{(jc-.\-) 2 } 

The optimal value of K is the one that yields the minimum variance, i.e. 

d P 


d K 


= 0 


Substitution of equation (9.62) into (9.63) gives 


Hence K is given by 


From which 


P = K 2 P a + (1 - K)-P b 


-{K 2 P a + {\-K) 2 P b }=0 


K = 


P.4 + P B 

Substitution of equation (9.66) into (9.62) provides 

f Pa 1 


(9.63) 


(9.64) 


(9.65) 


(9.66) 


x = A 


P .4 T P B 


(A x - B x ) 


(9.67) 



286 Advanced Control Engineering 



Fig. 9.5 Integration of two measurement systems to obtain optimal estimate. 


or 

x = A x - K(A X - B x ) 

K is the Kalman gain and the total error variance expected is 

P= Pa- K(P a - P B ) 

so that 

x = x + P A - K(P a - P B ) 
Equation (9.70) is illustrated in Figure 9.5. 


(9.68) 

(9.69) 

(9.70) 


9.4.3 The Kalman filter multivariable state estimation problem 

Consider a plant that is subject to a Gaussian sequence of disturbances w (kT) with 
disturbance transition matrix Cd (T). Measurements z (k+ 1 )T contain a Gaussian 
noise sequence v(k + \)T as shown in Figure 9.6. 

The general form of the Kalman filter usually contains a discrete model of the 
system together with a set of recursive equations that continuously update the 
Kalman gain matrix K and the system covariance matrix P. 

The state estimate x(£+ 1 /k+ 1) is obtained by calculating the predicted state 
x(k + 1 / k ) from 

x(k + l/k)T = A(T)x(k/k)T + B(T)u(kT) (9.71) 

and then determining the estimated state at time (k+ 1 )T using 

x(k+l/k + \)T=x(k+\/k)T + K(k+ l){z (k+ \)T - C(T)x(k + l/k)T} (9.72) 

The term (k/k) means data at time k based on information available at time k. The 
term ( k + 1 / k ) means data used at time k + 1 based on information available at time 
k. Similarly (k + 1 /k + 1) means data at time k + 1 based on information available at 
time k + 1 . 

The vector of measurements is given by 

z (k + 1 )T = C(T)x(k + \)T + v(k + 1 )T 


(9.73) 
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Disturbance noise 



where 

z(k + 1)7 is the measurement vector 
C(T) is the measurement matrix 
v(A + 1 ) T is a Gaussian noise sequence 

The Kalman gain matrix K is obtained from a set of recursive equations that 
commence from some initial covariance matrix P (k/k) 

P (A + 1/A) = A(T)P(k/k)A T (T) + C d (T)QC J d (T) (9.74) 

K (k + 1) = P (A + l/k)C J (T){C(T)P(k + l/k)C J (T) + R}~‘ (9.75) 

P (A + 1/Jfc + 1) = {I - K (A + 1)C(D}P(A- + 1/A’) (9.76) 

The recursive process continues by substituting the covariance matrix P(k + 1/A + 1) 
computed in equation (9.76) back into (9.74) as P(A/A) until K(A + 1) settles to a 
steady value, see Appendix 1, script files kalfilc.m for the continuous solution and 
kalfild.m for the above discrete solution. In equations (9.74)-(9.76) 

Cd (T) is the disturbance transition matrix 
Q is the disturbance noise covariance matrix 
R is the measurement noise covariance matrix 

Equations (9.71) (9.76) are illustrated in Figure 9.7 which shows the block diagram 
of the Kalman filter. 

The recursive equations (9.74)-(9.76) that calculate the Kalman gain matrix and 
covariance matrix for a Kalman filter are similar to equations (9.29) and (9.30) that 
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Fig. 9.7 The Kalman filter. 


calculate the feedback matrix and Riccati matrix for a linear quadratic regulator. The 
difference is that the Kalman filter is computed in forward-time, the LQR being 
computed in reverse-time. 


9.5 Linear Quadratic Gaussian control system design 

A control system that contains a LQ Regulator/Tracking controller together with a 
Kalman filter state estimator as shown in Figure 9.8 is called a Linear Quadratic 
Gaussian (LQG) control system. 



Fig. 9.8 Linear Quadratic Gaussian (LQG) control system. 
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Case study 

Example 9.3 (See also Appendix 1, examp93 .m) 

China clay is used in the paper, ceramics and fertilizer industries, and is washed from 
quarry faces, by high pressure hoses. A pressing operation reduces the moisture 
content in the clay to about 30%, and then the clay is extruded into small cylindrical 
shaped noodles. The clay noodles are then passed through the band drying oven 
shown in Figure 9.9 at rates varying between 2 and 15 tonnes/hour. Upon exit, the 
moisture content of the clay should be controlled to a desired level of between 4 and 
12%, with a deviation of no more than ±1%. The process air is heated by mixing the 
exhaust gas from a gas burner with a large quantity of dilution air to meet the 
specified air flow-rate into the dryer. 

An existing control arrangement uses a PID controller to control the temperature 
of the process air (measured by thermocouples) and the dry clay moisture content 
measured by samples taken by the works laboratory. If this is out of specification, 
then the process air temperature is raised or lowered. The dry clay moisture content 
can be measured by an infrared absorption analyser, but on its own, this is consid- 
ered to be too noisy and unreliable. 

The important process parameters are 

(a) Burner exhaust temperature q,(0 (°C) 

(b) Dryer outlet temperature U(0 (°C) 

(c) Dryer outlet clay moisture content ni[(t) (%) 

The important control parameters are 

(i) Burner gas supply valve angle v a (?) (rad) 

(ii) Dryer clay feed-rate f(t) (tonnes/hour) 


Process Air 

i 111 

Wet 1 

Clay In ^ Top Band — ► 


Top Band 


Middle Band 


Lower Band 


i J T 


Exhaust Air 


Dry Clay 
, Out 


Fig. 9.9 Band drying oven. 
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A proposed control scheme by Drew and Burns (1992) uses an LQG design, whereby 
the three process parameters are controlled in an optimal manner, their values 
(particularly the moisture control) being estimated. 

System model : The dynamic characteristics of the dryer were measured experimen- 
tally. This yielded the following transfer functions 


Burner model 


Dryer model 


Moisture models 


G\{s) = ^(s) 

V a 


420 

1+47.? 


G 2 (s) 



0.119 

1 + 200.S 


Gn(s) 


M f -0.167 
7d 1 +440.? 




M f 0.582 
7i 1 +440.? 


Equations (9.79) and (9.80) can be combined to give 


Mf(s) = 


-0.1677d(j) + 0.582Fi(s) 
1 + 440? 


(9.77) 

(9.78) 

(9.79) 

(9.80) 

(9.81) 


The block diagram of the system is shown in Figure 9.10. 

Continuous state-space model: From equations (9.77)— (9.8 1) 

47+ + t h (t) = 420 v a (t) 

200i d + ? d (0 = 0.119r d (0 (9.82) 

440/?7f + = — 0.167? d (f) + 0.582/i(T) 



Fig. 9.10 Model of band dryer system. 
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Define the state variables 


x\ = tb, x 2 = t d, x% — m f 


and the control variables 


u 1 = v a 

and the disturbance variables 

Wl = 0, H'2 = 0, w 3 =f 

then equations (9.82) can now be written as 

x\ = -0.02128.vi + 8.93617i/i + Cdnii’i 

X 2 = 0.00060.V] — 0.00500x2 + Cd22” ; 2 (9.83) 

X3 = — 0 . 00038 x 2 — 0 . 00227 x 3 + 0 . 00132 h ’3 

where Cdn and Cd22 are unknown burner and dryer disturbance coefficients, and are 
given an arbitrary value of 0.1. The state equations are written in the form 

x = Ax + Bu + CdW 


Xi 


—0.0213 

0 

0 


'xi 


'8.9362' 

X 2 

= 

0.0006 

-0.005 

0 


x 2 

+ 

0 

X 3 _ 


0 
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-0.0023 _ 


_X 3 _ 


0 



1 

O 

O 

O 

1 


Wi 

+ 

0 0.1 0 


w 2 


0 0 0.00132 


W3 


and the output equation is 




0 

0 


~Xi~ 


= 

0 1 0 


X 2 

mf 


0 

0 


_x 3 _ 


(9.84) 


Discrete system model: The discrete system model (without disturbances) is given by 
\(k + 1 )T = A (T)x(kT) + B(T)u(kT) (9.85) 


For a sampling time of 2 seconds, from equations (8.78) and (8.80) 


ACT) = 


[ 0.9583 

0 

0 


r 17.4974] 

0.0012 

0.9900 

0 

; B(T) = 

0.0105 

0 

-0.0008 

0.9955 


0 


(9.86) 


LQR Design: Using the quadratic performance index 


J = 


(x t Qx + u T Ru)dz 


'OO 
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where Q and R are diagonal matrices of the form 

~<lu 0 0] r. n i 

Q = 0 <722 o ; R = " , U (9.87) 

[ 0 0 ^33 J ' 22j 

From equations (9.20) and (9.21), the optimal control law is 

u opt = -Kx 

where 

K = R ! B t P (9.88) 

The design procedure employed was to maintain R as unity scalar, and systematically 
vary the diagonal elements of Q to achieve the performance specification. This was to 
maintain a dry clay moisture content of 6%, ± 1 %, as the clay feed-rate varied from 6 
to 10 tonnes/hour. Also the drying oven temperature t& should not vary more than 
±3°C from the set point of 50 °C. At each design setting, the clay feed-rate was 
varied according to 

w 3 (t) = 8 + 2sin(0. 001547) (9.89) 

Some results are presented in Table 9.1. 

It was found that qn had little effect, and was set to zero. From Table 9.1, the 
settings that meet the performance specification are 

'0 0 O' 

Q = 0 0.5 0 r = 1 (9.90) 

_0 0 20 _ 

From equation (9.25), the Riccati matrix is 

0 0.1 — 0.2 ' 

P= 0.1 10.8 -30 (9.91) 

-0.2 -30 3670. 4_ 

which gives, from equation (9.88), the feedback gain matrix 

K= [0.0072 0.6442 -1.8265] (9.92) 

The same results are also obtained from the discrete equations (9.29) and (9.30). 


Table 9.1 Variations in dryer temperature and moisture content 


qn 

<733 

Variation in temperature td (°C) 

Variation in moisture content (%) 



Max 

Min 

Max 

Min 

3 

1 

0.17 

0 

2.09 

-2.11 

1 

3 

0.99 

0 

1.74 

-2.13 

0.5 

3 

1.524 

0 

1.5 

-2.15 

0.5 

6 

2.05 

-2.05 

1.27 

-1.27 

0.5 

10 

2.42 

-2.42 

1.1 

-1.1 

0.5 

20 

2.86 

-2.86 

0.89 

-0.89 
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The closed-loop eigenvalues are 

5 = -0.0449 ±j0.0422 
5 = -0.0033 

Implementation: The optimal control law was implemented by using 


(9.93) 


ui = Ke 


where 


e = (r - x) 


(9.94) 


This is shown in Figure 9.11. 

A discrete simulation was undertaken using equations (9.85) and (9.86) together 
with a disturbance transition matrix Cd(T), which was calculated using Cd in equa- 
tion (9.84) and equation (8.80) for B(T), with a sampling time of 2 seconds. 


C d (T) = 


0.1958 

0.0001 

0 


0 0 

0.199 0 

-0.0001 0.0026 


The desired state vector was 


r = 


450 

50 

-6 


(9.95) 


(9.96) 


Note that the moisture content r 3 is negative because of the moisture model in 
equation (9.79). The initial conditions were 


x (0) = 


200 

30 

-30 


(9.97) 



Fig. 9.11 Optimal control of band dryer. 
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and the disturbance vector 


0 

0 

W3 


(9.98) 


where vr 3 , the clay feed-rate was set at a value between 6 and 10 tonnes/hour. Figure 
9.12 shows the time response of uy(t), the gas-valve angle in radians. The valve angle 
was not allowed to have a negative value, so remained closed for the first 80 seconds 
of the simulation, when the dryer was cooling. The steady-state angle was 0.95 
radians, or 54°. 

Figure 9.13 indicates the burner temperature time response The temperature 
falls from its initial value, since the gas valve is closed, and then climbs with a 
response indicated by the eigenvalues in equation (9.93) to a steady-state value of 
400 °C, or a steady-state error of 50 °C. 

Figure 9.14 shows the combined response of the dryer temperature ?d(0 and the 
moisture content the latter being shown as a positive number. The dryer 

temperature climbs to 48 °C (steady-state error of 2°C) and the moisture falls to 
6%, with no steady-state error. In this simulation the clay feed-rate w 3 (/) was 
constant at 8 tonnes/hour. 

As the band dryer is a type zero system, and there are no integrators in the 
controller, steady-state errors must be expected. Flowever, the selection of the 
elements in the Q matrix, equation (9.90), focuses the control effort on control- 



Fig. 9.12 Time response of gas-valve angle Uy ( t ). 
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Fig. 9.13 Time response of burner temperature t^t). 


ling the moisture content, at the expense of, in particular, the burner temperature 
tb(t). 

Figure 9.15 shows the final 500 seconds of the moisture content simulation as the 
clay feed-rate is varied between 6 and 10 tonnes/hour. After 1 000 seconds, as the clay 
leaves the dryer, the moisture content is between 5.2% and 6.8%, which is within the 
specification of ±1% of the set point of 6%. 

Kalman filter design : If the three stages of the covariance matrix P are written as 
P (A/A) = Pi; P (A + I/A') = P 2 and P(A' + 1/A + 1) = P3, then recursive equations 
(9.74), (9.75) and (9.76) become 


P 2 = AP,A T + C d QC^ 

K = P 2 C t {CP 2 C t + R}~‘ (9-99) 

P 3 = {I - kc}p 2 

Equation set (9.99) is simpler to visualize, but remember the system matrices are the 
transition matrices A (T), B(T) and Cd (T). Before recursion can start, values for R, 
the measurement noise covariance matrix, and Q, the disturbance noise covariance 
matrix must be selected. 

Measurement noise covariance matrix R: The main problem with the instrumentation 
system was the randomness of the infrared absorption moisture content analyser. 
A number of measurements were taken from the analyser and compared with samples 
taken simultaneously by work laboratory staff. The errors could be approximated to 
a normal distribution with a standard deviation of 2.73%, or a variance of 7.46. 


Moisture Content (%) <P Dryer Temperature (°C) and Moisture Content (%) 


296 Advanced Control Engineering 



9.14 Combined response of dryer temperature t^(t) and moisture content mf(f). 



Time (s) 


Fig. 9.15 Effect of varying clay feed-rate. 


Optimal and robust control system design 297 


The thermocouples measuring the burner and dryer temperatures were relatively 
noise-free, with standard deviations in the order of 0. 1 °C. The variance was therefore 
set at 0 . 01 , giving 


R = 


0.01 

0 

0 


0 

0.01 

0 


0 

0 

7.46 


(9.100) 


Disturbance noise covariance matrix Q: This was set as a diagonal matrix, where q\\ 
and q 22 represent changes in the burner and dryer temperatures as a result of 
changing heat transfer through the walls of the dryer, due to wind and variations 
in external temperature. 

On the other hand, q 33 is a measure of clay feed-rate variations, and a standard 
deviation of 0.3 tonnes/hour seemed appropriate. In the absence of any other infor- 
mation, standard deviations of the burner and dryer temperatures was also thought to 
be in the order of 0.3 °C. Thus, when these values are squared, the Q matrix becomes 


Q = 


0.1 0 0 

0 0.1 0 

0 0 0.1 


(9.101) 


Before equations (9.99) can be run, and initial value of P(A’/7r) is required. Ideally, 
they should not be close to the final value, so that convergence can be seen to have 
taken place. In this instance, P {k/k) was set to an identity matrix. Figure 9.16 shows 
the diagonal elements of the Kalman gain matrix during the first 20 steps of the 
recursive equation (9.99). 



Fig. 9.16 Convergence of diagonal elements of Kalman gain matrix. 


Measured and Filtered Moisture Content (%) 
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Fig. 9.17 Measured and filtered clay moisture content. 
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The final values of the Kalman Gain matrix K and covariance matrix P were 



'0.4408 

0.0003 

0 


'0.0044 

0 

0 

K = 

0.0003 

0.4579 

0 

; p = 

0 

0.0046 

0 


0 

-0.0006 

0.0325 


0 

0 

0.2426 


The full LQG system, comprising of the LQ optimal controller and Kalman filter was 
then constructed. Figure 9.17 shows a set of moisture content measurements Z 3 (kT) 
together with the estimated moisture content x^(kT). 


9.6 Robust control 
9.6.1 Introduction 

The robust control problem is to find a control law which maintains system response 
and error signals within prescribed tolerances despite the effects of uncertainty on the 
system. Forms of uncertainty include 

• Disturbance effects on the plant 

• Measurement noise 

• Modelling errors due to nonlinearities 

• Modelling errors due to time-varying parameters 

In previous chapters, linear models have been used to describe plant dynamics. 
However, in section 2.7.1 it was demonstrated that nonlinear functions could be 
linearized for small perturbations about an operating point. It is therefore possible to 
describe a nonlinear system by a series of linear models each constructed about 
a known operating point. If the operating point can be linked to a measurement, then 
a simple robust system may be constructed using an LQG approach. The feedback 
and Kalman gain matrices are calculated in advance for each operating point and 
some form of interpolation used to provide a ‘Gain Scheduling Controller.’ 

The disturbance and measurement noise is taken into account by the Kalman 
filter. In the following example, undertaken by the author (1984), a non-linear 
simulation of a ship of length 161m and displacement 17 000 tonnes was given 
a series of step changes in demanded rudder-angle at forward speeds of 2.572 m/s 
(5 knots), 5. 145 m/s (10 knots) and 7.717 m/s (15 knots). At each forward speed a linear 
model was constructed and the Q and R matrices in an LQG implementation selected 
to return the closed-loop eigenvalues back to some desired value (Ackermann’s 
formula could not be used since y (?) and u(7) were vector, not scalar quantities). 

A subset of the state error variables is 

e \ (?) = cross-track position error 
e 2 (0 = cross-track velocity error 
e-i (t) = heading error 
e 4 (t) = heading-rate error 
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The feedback control is of the form 


tiopt — h e 

where the values of K for the three forward speeds are 


K - 2.572 = [ 0.0121 
K 5 . 145 = [0.0029 
K 7.717 = [0.0013 


1.035 7.596 160.26] 

0.3292 1.81 25.963] 

0.1532 0.8419 8.047] 


(9.103) 


If the forward velocity of the ship is the state variable u s , a best estimate of which is 
given by the Kalman filter, the gain scheduling controller can be expressed as 


k\ = 0.08w“ 20 
k 2 = 6.0 u~ ls 
k 3 = 50.0 u~~ 0 
k 4 = 2090. 0m~ 2 ' 72 


(9.104) 


Equation set (9.104) approximates to an inverse square law, and increases the 
controller gains at low speeds, where the control surfaces are at their most insensitive. 

In general, however, robust control system design uses an idealized, or nominal 
model of the plant G m (s). Uncertainty in the nominal model is taken into account by 
considering a family of models that include all possible variations. The control 
system is said to have robust stability if a controller can be found that will stabilize 
all plants within the family. However, on its own, robust stability is not enough, since 
there may be certain plants within the family that are on the verge of instability. 
A controller is said to have robust performance if all the plants within the family meet 
a given performance specification. 


9.6.2 Classical feedback control 

Figure 9.18 shows a classical feedback control system D(s ) is a disturbance input, 
N(s) is measurement noise, and therefore 

Y (s) = G(s) U(s) + D(s ) 

B(s) = Y(s) + N(s) (9.105) 

U(s) = C(,v)( R(s) - fi(.Y)) 



Fig. 9.18 Classical feedback control system. 
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Eliminating U(s) and B(.s) from equations (9.105) gives 

G(.QC(4R(j) D(s) G(s)C(s)N (s) 

U 1 + G(s)C(s ) 1 + G(s)C(s) 1 + G(s)C(s) 1 ' ’ 

Define a sensitivity function S(s) that relates Tfy) and D(s) when R(s) = N(s ) = 0 


j } (s) = S(s) = r 


1 


G(s)C(s) 

and define a complementary sensitivity function 

G(s)C(s) 


T(s) = 1 - S(s) = 


1 + G(s)C(s) 

Thus, when N(s ) = 0, equation (9.106) may be written 

Y(s) = T(s)R(s) + S(s)D(s) 


(9.107) 


(9.108) 


(9.109) 


If T(s) = 1 and S(s) = 0 there is perfect set-point tracking and disturbance rejection. 
This requires that G(s)C(.s) is strictly proper (has more poles than zeros), so that 

lim G(s)C(s) = 0 (9.110) 


However, if N(s ) ^ 0, then equation (9.106) becomes 

Y(s) - T(s)R(s) + S(s)D(s ) - T(s)N{s) (9. Ill) 

Hence, if T{s) = 1, there will be both perfect set-point tracking and noise acceptance. 
Considering the problem in the frequency domain however, it may be possible that at 
low frequencies T( jw) — > 1 (good set-point tracking) and at high frequencies 
T{)lo) — > 0 (good noise rejection). 


9.6.3 Internal Model Control (IMC) 

Consider the system shown in Figure 9.19 G(s) is the plant, G m (,s) is the nominal 
model, R{s) is the desired value, U ( 5 ) is the control, D(s) is a disturbance input, Y (s) is 
the output and N(s) is the measurement noise. C(s) is called the IMC controller and is 
to be designed so that y(t) is kept as close as possible to /-( t) at all times. 

From Figure 9.19, the feedback signal B{ s) is 

B(s) + G(s)U(s) + D(s) + N(s) - G m (s)U(s) 

or 

B(s) = (G(s) - G m (s)) U (s) + D(s) + N(s ) (9.11 2) 

If, in equation (9.112) the model is exact, i.e. G m (f) = Gfs) and the disturbance D(s) 
and noise N(s) are both zero, then B(s ) is also zero and the control system is 
effectively open-loop. This is the condition when there is no uncertainty. However, 
if G m (s ) ^ G(s), and D(s) and N{s) are not zero, then B(s) expresses the uncertainty of 
the process. 
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Fig. 9.19 Block diagram of an IMC system. 


9.6.4 IMC performance 


From Figure 9.19 

Y(s) = G(s)U(s ) + D(s) 

B(s) = Y(s ) + N(s) - G m (s) U (.s') (9.113) 

U(s) = C(s)(R(s) - B(s )) 

Eliminating U(s ) and B(s) from equations (9.113) gives 

G(s)C(s)R( S ) , (1 - C(j)G m (s))D(s) G(5)C(5)A(5) 


Y(s) = - 


1 + C(s)(G(s) - G m (s)) 1 + C(j)(G(j) - G m (j)) 1 + C(s)(G(s) - G m (s )) 

(9.114) 


The sensitivity function S(s) that relates Y(s) and D(.s) when R(s) = N(s) = 0 is 

(9.115) 


D y> ’ \ + C(s){G{s)-G m {s)) 


and the complementary sensitivity function 
T(s) = 1 - 5(5) = 


C(s)G(s) 


1 + C(s)(G(s) - G m (s)) 
Thus, when N(s) = 0, equation (9.1 14) may be written 

Y(s) = T(s)R(s ) + S(s)D(s) 


(9.116) 


(9.117) 


If T(s) = 1 there is perfect set-point tracking. This will occur if G' m (.v) = G(s) and 
C(s) = l/G(s). If 5(5 ) = 0 there is perfect disturbance rejection. Again, this will occur 
if G m (s) = G(s ) and C(5) = 1 /C m ( 5 ) . 


Two degree-of -freedom IMC system 

If good set-point tracking and good disturbance rejection is required when the 
dynamic characteristics of R(s) and D(s) are substantially different, then it may be 
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Fig. 9.20 Two degree-of-freedom IMC system. 


necessary to introduce a second controller, which provides a second degree-of-free- 
dom of control action. A two degree-of-freedom IMC system is shown in Figure 9.20. 
With a two degree-of-freedom IMC system, equation (9.1 14) becomes 


G(i)C r (^)J?(j) (1 - C d (s)G m (s))D(s) 

1 + C d (,s)(C(.5) - G m (s)) 1 + C d (s)(G(s) - G m (s)) 
G(s)C d (s)N(s) 

1 + C d (.s)(G(.s) - G m (s)) 


In equation (9.118) C r (,s) is designed for set-point tracking and C d (s) for disturbance 
rejection. 


9.6.5 Structured and unstructured model uncertainty 

Unstructured model uncertainty relates to unmodelled effects such as plant distur- 
bances and are related to the nominal plant C m (^) as either additive uncertainty £ a (s) 

G(s) = G m (s) + £ a (s) (9.119) 

or multiplicative uncertainty £ m (.s') 

G(s) = (1 + e m (s))G m (s) (9.120) 

Equating (9.119) and (9.120) gives 

Us) = lJs)G m (s) (9.121) 

Block diagram representations of additive and multiplicative model uncertainly are 
shown in Figure 9.21. 

Structured uncertainty relates to parametric variations in the plant dynamics, i.e. 
uncertain variations in coefficients in plant differential equations. 
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(a) Additive Mode Uncertainty (b) Multiplicative Uncertainty 

Fig. 9.21 Additive and multiplicative model uncertainty. 


9.6.6 Normalized system inputs 

All inputs to the control loop (changes in set-point or disturbances) are generically 
represented by V(s). The input V(s) is found by passing a mathematically bounded 
normalized input V 1 (s ) through a transfer function block W(s), called the input 
weight, as shown in Figure 9.22. 

Specific inputs 


Impulse V 1 (s) = 1 W(s) = 1 

(9.122) 

Step F'(s) = 1 W(s) = 1/s 

Thus for specific inputs 

V(s) = W(s ) F 1 (s) = W{s) (9.123) 

Sets of bounded inputs may be represented by 

? f°° 

11^(0112=/ ( vl (0) 2 di < 1 (9.124) 

Jo 

The left-hand side of equation (9.124) is called ‘the 2-norm of the input signal v 1 (/) 
squared’. Norms are mathematical measures that enable objects belonging to the 


l/(s) 


W(s) 


V(s) 


Fig. 9.22 Transformation of a normalized bounded input I / 1 (s) into an actual input V(s). 
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same set to be compared. Using Parseval’s theorem, equation (9.124) may be trans- 
formed into the frequency domain 



W(jio) 


2 

dw < 1 


(9.125) 


For a realizable controller to exist, all external signals that enter the control loop 
must be bounded. 


9.7 H 2 - and H^-optimal control 
9.7.1 Linear quadratic H 2 -optimal control 

The scalar version of equation (9.48), when »(t) is not constrained, and Q is unity, is 
called the Integral Squared Error (1SE), i.e. 


ISE = 



(9.126) 


The TU-optimal control problem is to find a contoller c(t) such that the 2-norm of the 
ISE (written ||e(?)||l) is minimized for just one specific input v(t). 

If, in equation set (9.105) B(s ) and Y(s) are eliminated and U(s) is written as 
C(s)E(s), then 

E(s) = , ^ r ) . , {R(s) - D(s) - N(s)} 

1 + G(s)C(s) 

= S(s){R(s) - D(s ) - N(s)} (9. 127) 

Also, from equation (9.123), for a specific input 

V(s) = W(s) (9.128) 

Using Parseval’s theorem, from equation (9.126) the control problem can 

be expressed in the frequency domain as 

1 r°° 

min||e(0||?= min— / |ii(jw)| 2 dw (9.129) 

c c 2 TTj^oo 

Substituting equations (9.127) and (9.128) into (9.129) gives 

1 r°° 

mm\\e(t)\\ 2 2 =mm— |5(jo;)IF(ja;)| 2 da; (9.130) 

f f 27T J ^ 

Thus the // 2 -optimal controller minimizes the average magnitude of the sensitivity 
function weighted by JV(juj), where W( jw) depends upon the specific input V(j J). In 
mathematical terms, the controller minimizes the 2-norm of the sensitivity function 
weighted by IF(jw). 
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9.7.2 ^-optimal control 

With i/oo-optimal control the inputs F(jw) are assumed to belong to a set of norm- 
bounded functions with weight W(juj) as given by equation (9.125). Each input 
V(jcu) in the set will result in a corresponding error E( jtu). The //^-optimal controller 
is designed to minimise the worst error that can arise from any input in the set, and 
can be expressed as 

min ll e (0lloo= min sup|S'(»IF(jw)| (9.131) 

C C U1 

In equation (9.131), sup is short for supremum, which means the final result is the 
least upper bound. Thus the /4 -optimal controller minimizes the maximum magni- 
tude of the weighted sensitivity function over frequency range lu, or in mathematical 
terms, minimizes the oo-norm of the sensitivity function weighted by W(juj). 


9.8 Robust stability and robust performance 
9.8.1 Robust stability 

Robust stability can be investigated in the frequency domain, using the Nyquist 
stability criterion, defined in section 6.4.2. 

Consider a Nyquist contour for the nominal open-loop system G m (ju/)C(jw) with 
the model uncertainty given by equation (9.119). Let I a (cj) be the bound of additive 
uncertainty and therefore be the radius of a disk superimposed upon the nominal 
Nyquist contour. This means that G(jcc) lies within a family of plants 7r(G(jw) € i r) 
described by the disk, defined mathematically as 

t t={G: |G(jw) - G m (jw)| < 4 (w)} (9.132) 

and therefore 


I4(jw)| < 4M (9.133) 

If the multiplicative uncertainty in equations (9.120) and (9.121) is defined as 

4(jw) 


4i(jw) — ■ . . 

G m (jw)C(jw) 

and the bound of multiplicative uncertainty 

4M 


4iM 


G m (jw)C(jw)| 


(9.134) 


(9.135) 


From equation (9.135) the disk radius (bound of uncertainty) is 

4M = |G m (jw)C(jw)|4i(w) (9.136) 

From the Nyquist stability criterion, let N(k, G(jtu)) be the net number of clockwise 
encirclements of a point (Ic, 0) of the Nyquist contour. Assume that all plants in the 
family n, expressed in equation (9.132) have the same number («) of right-hand plane 
(RHP) poles. 




Optimal and robust control system design 307 



Fig. 9.23 Robust stability. 

There will be robust stability of a specific controller C(jw) if and only if 

N(— 1, G(jcu)C(jw)) = — n for all G(jw) € 7t (9.137) 

It is also necessary for the nominal plant G m {jd) to be stable 

7V(-l,G m (jw)C(jw)) = -« (9.138) 

From Figure 9.23 robust stability occurs when the vector magnitude 
|1 + G m (ju;)C(ju;)| (see also Figure 6.25) exceeds the disk radius |G m (jtu)C(jtu)|f m (w) 

|1 + G m (ju)C(jw)| > |G m (jw)C(jcj)|f m (w) for all u 


or 


G m (jtu)C(jcu) 

1 + G m (jw)C( jw) 


£ m {u) < 1 


(9.139) 


Equation (9.139) uses the magnitude of the complementary sensitivity function T(jui) 
as defined in equation (9.108). Thus 

\T(\uj)\l m (uj) < 1 for all to (9.140) 

Robust stability can therefore be stated as: ‘If all plants G(.s) in the family i r have the 
same number of RHP poles and that a particular controller C(s) stabilizes the 
nominal plant G m (.s), then the system is robustly stable with the controller C(.s) if 
and only if the complementary sensitivity function T(s ) for the nominal plant G m (^) 
satisfies the following bound 

||T(jw)fmM||oo = sup|7’(jw)4 1 (w)| < 1 (9.141) 


where the LHS of equation (9.141) is the infinity norm of T(jw)f m (jw). This means 
that robust stability imposes a bound on the oo norm of the complementary sensi- 
tivity function T(]lo) weighted by (w)’. 
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9.8.2 Robust performance 

Robust stability provides a minimum requirement in an environment where there is 
plant model uncertainty. For a control system to have robust performance it should 
be capable of minimizing the error for the worst plant (i.e. the one giving the largest 
error) in the family G(jw) G 7 r. 

For the /f^-control problem, from equation (9.131), the oo-norm of the weighted 
sensitivity function can be written 

||5fF|| 00 =sup|5(ju;)fF(j W )| (9.142) 

U) 

If, as part of the design process, a bound is placed upon the sensitivity function 

\S(ju>)\ < \mjuT 1 (9-143) 

Should an H x controller be found such that 

||5fF|| 00 < 1 (9.144) 

then the bound in equation (9.143) is met. Hence, for robust performance 

HSIFII^ sup|S(jw)^(jo;)| < 1 for all G( jw) G tt (9.145) 

UJ 

From Figure 9.23 representing robust stability, the actual frequency response 
G(juj)C{jio) will always lie inside the region of uncertainty denoted by the disk, or 

|1 + G(jw)C(jw)| > |1 + G m (jw)C(jw)| - |Gni(jw)C(jtu)|4i(w) for all G(jw) G tt 

(9.146) 


giving 


\S(}uj)\ = 


1 


1 + G(ja;)C(jw) 


< 


|5,„(jw)| 


1 - 


for all G(jcc) G 7r (9.147) 


where ,S' m ( jtc) is the sensitivity function for the nominal plant 

5m(jw) = 1 + G m (jtu)C(jw) 

Using equation (9.147), equation (9.145) can be expressed as 

IMggwi <, foral ,„ 

1 - r m (jw)|f„,M 
or 

\T m (]u)i m {u)\ + |5 , m (jtu)lF(ja;)| < 1 for all w 


(9.148) 


(9.149) 


(9.150) 
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Robust performance then means that the closed-loop system will meet the perform- 
ance specification given in equation (9.145) if and only if the nominal system is 
closed-loop stable (equation (9.141)) and that the sensitivity function S m (jw) and 
complementary sensitivity function 7j m (ja;) for the nominal system satisfy the rela- 
tionship given in equation (9.150). 


Example 9.4 

(a) For the control system shown in Figure 9.24 produce the Bode magnitude plots 
for the sensitivity function |>S(ju;)| and the complementary sensitivity function 
|7Xju;)| when K = 10. Comment on their values. 

(b) For a step input, let W(s ) = l/s. Produce Bode magnitude plots for |S(jtu)l-F(ja;)| 
when K = 10, 50 and 100 and identify the optimal value using both Hi and H x 
criteria. 

Use a frequency range of 0.01-100 rad/s for both (a) and (b). 


Solution 

(a) From equation (9.107) 


S(s) 


1 _ 1 

1 + G(s)C(s) 1 + (1+J jf 1+2j ) 

2s 2 + 3j + 1 

2U + 3s + (l +K) 


(9.151) 


From equation (9.108) 


T {s) = 1 - S(s) = 1 


f 2s 2 + 3s + 1 | 

\2U + 35 + (l+A0J 


K 

2s 2 + 3 j + (!+£■) 


(9.152) 


The Bode magnitude plots for |>S(ja;)| and |T(jw)| are shown in Figure 9.25 for 
K = 10. From Figure 9.25 it can be seen that up to 1 rad/s, the system has a set- 
point tracking error of — 0.8dB (|r(jw)|) and a disturbance rejection of 
-20dB(|S(jw)|). 
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(b) For a specific input of a unit step, let W(s) = l/s. Hence the weighted sensitivity 
function is 


,S’(,s) W(s) = 


2s 1 + 3^+1 
5{25 2 + 35+(l+^)} 


(9.153) 


The Bode magnitude plots for |S(j<u)JF(ju/)| for K = 10, 50 and 100 are shown in 
Figure 9.26. 

From Figure 9.26 it can be seen that the // 2 -norm, or average value of the weighted 
sensitivity function (equation (9.130)) reduces as K increases and hence, using this 
criteria, K = 100 is the best value. Using the H x - norm as defined in equation (9.131), 
the maximum magnitude of the weighted sensitivity function occurs at the lowest 
frequency. The least upper bound therefore is OdB, occurring at 0.01 rad/s when 
K = 100, so this again is the best value. 

Example 9.5 

A closed-loop control system has a nominal forward-path transfer function equal to 
that given in Example 6.4, i.e. 

C " WCW = ^ + l + 4) 



- 2-10 1 2 

10 10 10 10 10 

Frequency (rad/s) 

Fig. 9.25 Bode magnitude plots for |S(jo;)| and |7“(juj)|. 
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Let the bound of the multiplicative model uncertainty be 


4i0) 


0.5(1 + s) 
(1 + 0.25s) 


What is the maximum value that K can have for robust stability? 

Solution 

At frequencies below 1 rad/s, I m (d) — > 0.5 and at frequencies above 4 rad/s 
I'm (w) — > 2.0. From equation (9.141), for robust stability 

|F(jud4M < 1 (9.154) 


now 


therefore 


T(s) = 


G m {s)C(s) 

1 + G m (s)C(s) 


T(s) 


K 

j 3 +2.y 2 +45’ 

1 _i_ K 

‘ j 3 +25 ,2 +45 


T(s) = 


K 

s 3 + 2s 2 +4s + K 



Frequency (rad/s) 


Fig. 9.26 Bode magnitude plot of weighted sensitivity function for Example 9.4. 
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Frequency (rad/s) 

Fig. 9.27 Bode plot of |r(jo;)^ m (uj)| for Example 9.5. 


thus 


T(s)£ m (s) = 


0.5K(l 
0.25 s)(s 3 


(9.155) 


( 1 + 0.25s)(s 3 + 2s 2 + 4s + Ai) 

The Bode magnitude plot for equation (9.155) is shown in Figure 9.27 when K = 2 
and 3.5. 

In Example 6.4, when there was no model uncertainty, K for marginal stability was 
8, and for a gain margin of 6 dB, K was 4. In this example with model uncertainty, 
from equation (9.154) marginal stability occurs with K = 3.5, so this is the maximum 
value for robust stability. For robust performance, equation (9.150) applies. For a 
specific step input let W(s ) = 1/s now 

c , , s 3 + 2s 2 + 4s 

s m s =TTTT71 — ; 7} (9.156) 

c . 1 1 n - ' 


and 


hence 


-S m (.y)lF(.y) = 


2s 2 + 4s + K 

s(s 2 + 2s + 4) 
s(s 3 + 2s 2 + 4s + K) 


S m (s)W(s) = 


-2s + 4 


s 3 + 2s 2 + 4 s + K 


(9.157) 


The Bode magnitude plot of the weighted sensitivity function is shown in Figure 9.28 
for K = 2, 2.5 and 3.5. 


Optimal and robust control system design 313 



Frequency (rad/s) 

Fig. 9.28 Bode magnitude plot of weighted sensitivity function for Example 9.5. 

For robust performance 

|r m (» + £ m (w) | + |S m (jw)tF(jcu)| < 1 for all u (9.158) 


From Table 9.2 it can be concluded that: 

(a) The control system has robust stability up to K = 3.5. 

(b) The H x - norm is >1 for all values of K considered. Therefore equations (9.145) 
and (9.150) are not met and the system cannot be considered to have robust 
performance. 

From (b) above, it must be concluded that the controller C(s) must be something 
more sophisticated than a simple gain constant K. 


Table 9.2 Robust performance for Example 9.5 


uj (rad/s) 


0.01 



1.5 


K 

2 

2.5 

3.5 

2 

2.5 

3.5 


0.5 (— 6dB) 

0.5 (not shown in 
Figure 9.27) 

0.5 

0.5 

0.63 (not shown in 
Figure 9.27) 

1.0 

|s m (jiu) troll 

2.0 (6dB) 

1.58 

1.12 

0.96 

1.05 

1.26 

Sum 

2.5 

2.08 

1.62 

1.46 

1.68 

2.26 
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9.9 Multivariable robust control 


9.9.1 Plant equations 

The canonical robust control problem is shown in Figure 9.29. 

In Figure 9.29, u 2 are the inputs to the plant P m from the controller and U| are the 
disturbance and noise inputs. Also, yj are the outputs to be controlled and y 2 are the 
outputs that are fed back to the controller. 

If Pm (.v) and the plant uncertainty A(.v) are combined to give P(,v). then Figure 9.29 
can be simplified as shown in Figure 9.30, also referred to as the two-port state-space 
representation. 

The state and output equations are 


x = Ax + B]U] + B 2 u 2 
yi = Cix + Dnui +Di 2 u 2 
y 2 = C 2 X + D 2 ,ui + D 22 u 2 

Equation (9.159) can be combined 


X 


A Bj B2 


X 

yi 

= 

Ci Dn D] 2 


Ul 

_y2. 


C 2 D 2 i D 22 


_ u 2 _ 


(9.159) 


(9.160) 


Uncertainty 



Fig. 9.29 The canonical robust control problem. 
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Fig. 9.30 Two-port state-space augmented plant and controller. 


Hence the augmented plant matrix P(,v) in Figure 9.30 is 

Pn 

P 21 



A 

B, 

b 2 

P(j) = 


: D|, 

D 12 

Ci 


[c 2 

D 21 

D 22 


P 12 

P 22 


(9.161) 


From the partitioned matrix in equation (9.161), the closed-loop transfer function 
matrix relating y, and U[ is 


where 


Ty,ui = PnCs) + Pi 2 W(I - C^PaW )- 1 C(s)P 2 i(s), (9.162) 

u 2 (s) = C(s)y 2 (s) (9.163) 


9.9.2 Singular value loop shaping 

The singular values of a complex n x m matrix A, denoted by 07 (A) are the non- 
negative square-roots of the eigenvalues of A T A ordered such that 

fi > cr 2 > ■ ■ ■ > tip p = min{«, in} (9.164) 

The maximum singular value <7 of A and the minimum singular value er of A are 
defined by 


o-(A) = ||A || 2 

o;(A) = HA ^ 1 ||T 1 if A -1 exists 
As with a S1SO system, a sensitivity function may be defined 


S(s) = (I + G(s)CMT 


(9.165) 


1 


(9.166) 
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where G(s) is the non-augmented plant matrix. For good performance S(.s) should 
be as small as possible. The complementary sensitivity function is 

T(s) = G(s)C(s)(I + G(.y)C(j)r 1 (9.167) 

where 

S(s) + T(s) = 1 (9.168) 

The singular value of the sensitivity function <r(S(jtu)) and of the complementary 
sensitivity function <r(T(ju;)) can be displayed as Bode plots and play an important 
role in robust multivariable control system design. 

The singular values of S determine the disturbance attenuation, and thus a per- 
formance specification may be written 

d(S(»)< (W^O)! (9.169) 

where | Wg - 1 ( jo^) I is a desired disturbance attenuation factor. If A nl (.$) is a diagonal 
matrix of multiplicative plant uncertainty as illustrated in Figure 9.29, it can be 
shown that the size of the smallest stable A m (s) for which the system becomes 
unstable is 


d(A m (jca)) = l/d(T(jca)) (9.170) 

or alternatively 

dfT(jw)) < IWj'ljw)! (9.171) 


where |WT(jw)| is the size of the largest anticipated multiplicative plant uncertainty. 


9.9.3 Multivariable H 2 and H ^ robust control 

The // 2 -optimal control problem is to find a stabilizing controller C(s) in equation 
(9.163) for an augmented plant P(.s) in equation (9.161), such that the closed-loop 
transfer function matrix Ty^i in equation (9.162) is minimized. 

Thus 


(If 00 1 P 2 

min 1 1 Ty , u, || 2 = min^ - / trace(Ty 1 u 1 (jw) T Ty 1 ui(ju;))dw \ (9.172) 

c 6) C(s) (7T J Q J 

where T is the complex conjugate transpose, and trace is the sum of the diagonal 
elements. The II X robust control problem is to find a stabilizing controller C(,v) for 
an augmented plant P(^), such that the closed-loop transfer function matrix T y , u 1 
satisfies the infinity-norm inequality 

l|Tyi u i lloo= SU P ^max(Ty,ui(jw)) < 1 (9.173) 


Equation (9.173) is also called the ‘small gain’ infinity-norm control problem. 



Optimal and robust control system design 317 


9.9.4 The weighted mixed-sensitivity approach 

Multivariable loop shaping in robust control system design may be achieved using 
a weighted mixed sensitivity approach. As with the SISO systems described in section 
9.8.2, the sensitivity function S(.v) given in equation (9.166) and the complementary 
sensitivity function T(,sj given in equation (9.167) may be combined with weights 
W S (s) and W T (.s) to give 


Ty,ui 


w,(s) SCO 
Wt(0 T(0 


(9.174) 


where the infinity norm of Ty,ui is <1 as given in equation (9.173). Equation (9.174) 
defines a mixed-sensitivity cost function since both S(.v) and T(0 are penalized. Note 
that if W 8 (0 weights the error and Wj(0 the output, the two-port augmented plant 
given in Figure 9.30 may be represented by Figure 9.31. 

Example 9.6 (See also Appendix 1, examp96.m) 

A plant has a transfer function 


G(s) 


200 

^ 3 + 3^ 2 + 102.V + 200 


given the sensitivity and complementary weighting functions 


W s (s) = 7 


/ 100 + .A 
\l + ms) 


W T (s) 


/I + 100.A 
V iooh- 5 y 


(9.175) 


(9.176) 




Fig. 9.31 Weighted mixed-sensitivity approach. 


318 Advanced Control Engineering 


determine the singular value Bode magnitude plots for 

(a) the plant G(jcu) 

(b) the weighting functions fF s -1 (jw) and 

(c) the cost function TyjUifjw) at its optimal value of 7 (given in IV s (s)) 

(d) the /foo-optimal controller C(]u>) 

Find also the state-space and transfer function expressions for the controller. 
Solution 

The state-space representation of the plant G(s) is 


Ag Bg 
Cd Dg 


-3 -102 -200 

1 0 0 

0 1 0 


1 

0 

0 


0 0 200 ! 0 


(9.177) 


The singular value frequency response G(juj) is shown in Figure 9.32. 

The frequency response of the reciprocal of the weighting functions fF s _1 (jw) 
(7 = 1) and are given in Figure 9.33. 

The optimal value of Ty,ui is achieved when (7= 0.13) and its singular value 
frequency response is shown in Figure 9.34. 

The controller single value frequency response C(jw) is illustrated in Figure 9.35. 



Frequency (rad/s) 

Fig. 9.32 Plant singular value Bode magnitude plot. 


Optimal and robust control system design 319 



Frequency (rad/s) 


Fig. 9.33 Weighting functions Bode magnitude plots. 



icr 3 io -2 io _1 io° io 1 io 2 io 3 

Frequency (rad/s) 


Fig. 9.34 Singular value Bode magnitude plot of |Tyi u-|( jw)| when 7 = 0.1 3. 
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1CT 3 10“ 2 ICf 1 10° 10 1 10 2 10 3 

Frequency (rad/s) 

Fig. 9.35 Controller single value Bode magnitude plot |C(ju)|. 

The state-space representation of the controller C(s) is 


-0.01 

-0.002 

0.004 

0.015 

0.137 

-7.976 

-0.009 

-7.763 

21.653 

37.164 

621.89 

0.091 

-0.046 

-2.032 

-3.148 

-2.234 

-81.88 

0.582 

0.435 

0.107 

8.807 

-102.25 

-37.78 

1 

OO 

oo 

0.676 

0.197 

13.558 

-3.728 

-162.51 

-13.66 

-0.086 

0.169 

0.121 

-0.654 

-11.17 

0 


(9.178) 


and the controller transfer function is 

159/ + 16.4 x 10 3 / + 63.9 x 10V + 1.6 x 10 6 .v+ 3.18 x 10 6 
(,V) " / + 275/ + 20.4 x 10 3 / + 324.8 x 10 3 / + 3.78 x 10 6 .s + 37.8 x 10 3 

(9.179) 


The results in this example were obtained using the MATLAB Robust Control 
Toolbox. 
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9.10 Further problems 

Example 9.7 

In a multivariable optimal regulator system, the plant state equations are 


'-V 


■ 0 

1 ' 

'X! ' 

+ 

'O' 

. X2 . 


.-4 

—2 

_ X2 _ 


.4. 


(9.180) 


y = [i 0]x 

If the performance index to be minimized is 

POO 

J= (x t Qx + u 2 )dt 


(9.181) 


(a) Determine, by hand, the elements of the Riccati matrix P in the reduced Riccati 
equation 


PA + A‘P + Q - PBR 'B t P = 0 


given that 


Q = 


2 0 
0 1 


(b) Find the optimal feedback matrix K so that 

K = R 'B t P 

and hence calculate the closed-loop eigenvalues. 


(9.182) 


(9.183) 


(9.184) 


Solutions 

p _ [ i - 7 °3 0.183' 

(a) ^ L° 183 0.193 

(b) K = [0.732 0.772] 

5= -2.544 ±j0.675 

Example 9.8 

A plant and measurement system are described by 


x = Ax + Bu + CdW 
y = Cx 
z = y + v 


(9.185) 
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where w (?) is a Gaussian sequence of disturbances and v(7) is a Gaussian sequence of 
measurement noise. z(t) is the measured value of y (?) that is contaminated with 
measurement noise v(Y). The plant parameters are 


A = 


C d = 


0 1 0 
0 0 1 
-50 -102 -4.5 
0.5 0 O' 

0 0.5 0 

0 0 10 


B 


C = 


0 

0 

100 
1 0 
0 1 
0 0 


0 

0 

1 


(9.186) 


The measurement noise and disturbance covariance matrices are 



' 0.1 

0 

o ' 


' 0.1 

0 

o ' 

R = 

0 

0.1 

0 

Q = 

0 

0.1 

0 


0 

0 

6 


0 

0 

2 


(9.187) 


(a) For a sampling time of 0.1 seconds, using equations (8.78) and (8.80) calculate 
the discrete-time state transition, control and disturbance matrices A (T), BIT) 
and Cd (T). 

(b) Starting with an initial covariance matrix P(k/k) equal to the identity matrix, 
perform 20 recursions of equations (9.74), (9.75) and (9.76) to compute the 
Kalman gain matrix K(£ + 1 ) and covariance matrix P(/r + l/k + 1). 

Solutions 


0.014 

0.398 

6.740 



' 0.050 

0.002 

o.oo r 


C d (T) = 

- 0.004 

0.043 

0.040 



— 0.100 

- 0.207 

0 . 674 _ 




' 0.040 

- 0.006 

- 0.002 

(b) K(/r+l) = 

- 0.006 

0.137 

0.003 



— 0.133 

0.155 

0.218 



' 0.004 

- 0.001 

- 0.013 

P(k+l/k + 1) = 

- 0.001 

0.014 

0.016 



- 0.013 

0.016 

1.310 



0.993 

0.085 

0.004 


(a) A(T) = 

-0.199 

0.587 

0.067 

B (T) = 


-3.370 

-7.074 

0.284 



Example 9.9 

The plant described in Example 9.8 by equations (9.185) and (9.186) is to be 
controlled by a Linear Quadratic Gaussian (LQG) control scheme that consists of 
a LQ Regulator combined with the Kalman filter designed in Example 9.8. The 
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quadratic performance index to be minimized for the LQ regulator is of the form 
given in equation (9.181) where 


Q = 


10 0 0 
0 5 0 

0 0 1 


(R= 1) 


(9.188) 


Using the recursive equations (9.29) and (9.30), solve, in reverse time, the Riccati 
equation commencing with P (N) = 0. 

If the sampling time is 0.1 seconds, the values of the discrete-time state transition 
and control matrices A (T) and B(r) calculated in Example 9.8 may be used in the 
recursive solution. 

Continue the recursive steps until the solution settles down (when k = 50, or 
kT = 5 seconds) and hence determine the steady-state value of the feedback matrix 
K(0) and Riccati matrix P(0). What are the closed-loop eigenvalues? 


Solutions 


K(0) = [-0.106 


P(0) = 


'11.474 

3.406 

0.153 


-0.581 

3.406 

3.952 

0.163 


0.064] 

0.153 ' 
0.163 
0.1086 


closed-loop eigenvalues = —1.230 


-4.816 ±./2.974 


Example 9.10 

A unity-feedback control system has a nominal plant transfer function 


G m (s) 


1 

(s + 2)(s + 5) 


(9.189) 


and an integral controller in the forward path 

C(s) = j (9.190) 

If the bound of the multiplicative model uncertainty is 


4iC s) 


0.25(1 + 4k) 
(1 + 0.25s) 


(9.191) 
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determine: 


(a) Expressions for the sensitivity and complementary sensitivity function S( s) and 
T( s) for the nominal plant. 

(b) The maximum value that K can have for robust stability. 

Solutions 


(a) S(s) 
T(s) 


s 3 + Is 2 + 10.v 
.s 3 + Is 1 + lO.v + K 
K 

s 3 + Is 1 +10 s + K 


(b) K max = 4.5 


Example 9.11 

A plant has a transfer function 


G(s) 


100 

s 2 + 2,s + 100 


and sensitivity and complementary weighting functions 

/«+ioo> 

W s (s) = 7 
W T (s) = 


s+ 1 
5 + 1 


100 


Find the optimal value for 7 and hence the state-space and transfer functions for the 
//oo-optimal controller C(.v). 


Solutions 
7 o P t = 0.0576 


—2.8 3.0 -1.4 150.9 : -4.55 

-3.0 -22.2 50.1 258.0 : 3.10 

A c B c ' 

C c D C J = -2.7 39.6 -74.5 196.1 : 2.99 

-3.2 -36.3 -23.2 -1871.1 : 7.44 

-0.33 1.68 1.02 -49.42 : 0 


1.86 x 10V + 0.1898 x 10V + 0.5581 x 10 6 j+ 18.6031 x 10 6 
■ ) 1.97 x 10V + 0.2005 x 10V + 1.3531 x 10 6 .9+ 1.1546 x 10 6 



10 


Intelligent control system 

design 


10.1 Intelligent control systems 

10.1.1 Intelligence in machines 

According to the Oxford dictionary, the word intelligence is derived from intellect, 
which is the faculty of knowing, reasoning and understanding. Intelligent behaviour 
is therefore the ability to reason, plan and learn, which in turn requires access to 
knowledge. 

Artificial Intelligence (AI) is a by-product of the Information Technology (IT) 
revolution, and is an attempt to replace human intelligence with machine intelli- 
gence. An intelligent control system combines the techniques from the fields of AI 
with those of control engineering to design autonomous systems that can sense, 
reason, plan, learn and act in an intelligent manner. Such a system should be able 
to achieve sustained desired behaviour under conditions of uncertainty, which 
include: 

(a) uncertainty in plant models 

(b) unpredictable environmental changes 

(c) incomplete, inconsistent or unreliable sensor information 

(d) actuator malfunction. 

10.1.2 Control system structure 

An intelligent control system, as considered by Johnson and Picton (1995), comprises 
of a number of subsystems as shown in Figure 10.1. 

The perception subsystem 

This collects information from the plant and the environment, and processes it into a 
form suitable for the cognition subsystem. The essential elements are: 

(a) Sensor array which provides raw data about the plant and the environment 

(b) Signal processing which transforms information into a suitable form 

(c) Data fusion which uses multidimensional data spaces to build representations of 
the plant and its environment. A key technology here is pattern recognition. 
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Intelligent Control System 



Fig. 10.1 Intelligent control system structure (adapted from Johnson and Picton). 


The cognition subsystem 

Cognition in an intelligent control system is concerned with the decision making 
process under conditions of uncertainty. Key activities include: 

(a) Reasoning, using 

(i) knowledge-based systems 

(ii) fuzzy logic 

(b) Strategic planning, using 

(i) optimum policy evaluation 

(ii) adaptive search and genetic algorithms 

(iii) path planning 

(c) Learning, using 

(i) supervised learning in neural networks 

(ii) unsupervised learning in neural networks 

(iii) adaptive learning 

The actuation subsystem 

The actuators operate using signals from the cognition subsystem in order to drive the 
plant to some desired states. In the event of actuator (or sensor) failure, an intelligent 
control system should be capable of being able to re-configure its control strategy. 

This chapter is mainly concerned with some of the processes that are contained 
within the cognition subsystem. 


10.2 Fuzzy logic control systems 
10.2.1 Fuzzy set theory 

Fuzzy logic was first proposed by Zadeh (1965) and is based on the concept of fuzzy 
sets. Fuzzy set theory provides a means for representing uncertainty. In general, 
probability theory is the primary tool for analysing uncertainty, and assumes that the 
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uncertainty is a random process. However, not all uncertainty is random, and fuzzy 
set theory is used to model the kind of uncertainty associated with imprecision, 
vagueness and lack of information. 

Conventional set theory distinguishes between those elements that are members of 
a set and those that are not, there being very clear, or crisp boundaries. Figure 10.2 
shows the crisp set ‘medium temperature’. Temperatures between 20 and 30 °C lie 
within the crisp set, and have a membership value of one. 

The central concept of fuzzy set theory is that the membership function /j, like 
probability theory, can have a value of between 0 and 1. In Figure 10.3, the member- 
ship function ji has a linear relationship with the x-axis, called the universe of 
discourse U. This produces a triangular shaped fuzzy set. 

Fuzzy sets represented by symmetrical triangles are commonly used because they 
give good results and computation is simple. Other arrangements include non- 
symmetrical triangles, trapezoids, Gaussian and bell shaped curves. 

Let the fuzzy set ‘medium temperature’ be called fuzzy set M. If an element u of the 
universe of discourse U lies within fuzzy set M, it will have a value of between 0 and 
1 . This is expressed mathematically as 

I-Im(u) e [0. 1] (10.1) 

When the universe of discourse is discrete and finite, fuzzy set M may be expressed as 

n 

M = J>m {ud/ui (10.2) 

i= 1 

In equation (10.2) ‘/’ is a delimiter. Hence the numerator of each term is the member- 
ship value in fuzzy set M associated with the element of the universe indicated in the 
denominator. When n = 11, equation (10.2) can be written as 

M = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 1/25 + 0.67/30 + 0.33/35 

+ 0/40 + 0/45 + 0/50 (10.3) 


A 4 

1.0 

Membership 
Function Q g 

0.6 
0.4 

0.2 

0 10 20 30 40 50 

Temperature (°C) 


Medium 

Temperature 


Fig. 10.2 Crisp set 'medium temperature'. 
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Membership 

Function 



Fig. 10.3 Fuzzy set 'medium temperature'. 


Note the symbol ‘+’ is not an addition in the normal algebraic sense, but in fuzzy 
arithmetic denotes a union operation. 


10.2.2 Basic fuzzy set operations 

Let A and B be two fuzzy sets within a universe of discourse U with membership 
functions /r A and pn respectively. The following fuzzy set operations can be defined as 

Equality. Two fuzzy sets A and B are equal if they have the same membership 
function within a universe of discourse U. 

Ma(m) = /in (w) for all u £ U (10.4) 

Uniom The union of two fuzzy sets A and B corresponds to the Boolean OR function 
and is given by 

Maub(w) = ma+bOO = max{/r A (w), I-Ir(u)} for all u £ U (10.5) 

Intersection-. The intersection of two fuzzy sets A and B corresponds to the Boolean 
AND function and is given by 

p atib(w) = min{/i A (w), I-Ir(u)} for all u £ U (10.6) 

Complement-. The complement of fuzzy set A corresponds to the Boolean NOT 
function and is given by 

i u-, a (m) = 1 — p\{ii) for all u £ U (10.7) 


Example 10.1 

Find the union and intersection of fuzzy set low temperature L and medium tem- 
perature M shown in Figure 10.4. Find also the complement of fuzzy set M. Using 
equation (10.2) the fuzzy sets for n = 11 are 
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0 10 20 30 40 50 

Universe of Discourse (Temperature (°C)) 

Fig. 10.4 Overlapping sets 'low' and 'medium temperature'. 


L = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 0.33/25 
+ 0/30 + 0/35 + • • • + 0/50 

M = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 1/25 + 0.67/30 
+ 0.33/35 + 0/40+ ••• + 0/50 

(a) Union-. Using equation (10.5) 

Ml+m(m) = max(0, 0)/0 + max(0.33, 0)/5 + max(0.67, 0)/10 

+ max(l, 0.33)/15 + max(0.67, 0.67)/20 + max(0.33, l)/25 
+ max(0, 0.67)/30 + max(0, 0.33)/35 + max(0, 0)/40 + • • • 

+ max(0, 0)/50 

Hl + m(u) = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 1/25 + 0.67/30 

+ 0.33/35 + 0/40 + ••• + 0/50 (10.10) 

(b) Intersection-. Using equation (10.6) and replacing ‘max’ by ‘min’ in equation 
(10.9) gives 

Humiu) = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 0.33/25 

+ 0/30 + ••• + 0/50 (10.11) 

Equations (10.10) and (10.11) are shown in Figure 10.5. 

(c) Complement-. Using equation (10.7) 

^m(u) = (1 - 0)/0 + (1 - 0)/5 + (1 - 0)/10 + (1 - 0.33)/15 

+ (1 - 0.67)/20 + (1 - l)/25 + (1 - 0.67)/30 + (1 - 0.33)/35 
+ (1 — 0)/40 + ••• + ( 1 — 0)/50 (10.12) 


( 10 . 8 ) 


(10.9) 


Equation (10.12) is illustrated in Figure 10.6. 
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Function 



Fig. 10.5 'Union' and 'intersection' functions. 


Membership 

Function 



Fig. 10.6 The complement of fuzzy set M. 

10.2.3 Fuzzy relations 

An important aspect of fuzzy logic is the ability to relate sets with different universes 
of discourse. Consider the relationship 

IF L THEN M (10.13) 

In equation (10.13) L is known as the antecedent and M as the consequent. The 
relationship is denoted by 


A = L x M 


(10.14) 


or 


min{ / u L (Mi), /t m (vi)} . . . min{yi L (Mi), ^ M (v*)} 
min {n L (uj), mm(vi)} ■ • • min {n L (uj), /i M (bt)} 


(10.15) 
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where u\ — > Uj and v\ — > v* are the discretized universe of discourse. Consider the 
statement 


IF L is low THEN M is medium (10.16) 

Then for the fuzzy sets L and M defined by equation (10.8), for U from 5 to 35 in 
steps of 5 


L x M = 


which gives 


min (0.33, 0) 


min (0.33, 1) 


min (0.33, 0.33) 

min (0.67, 0) 


min (0.67, 1) 


min (0.67, 0.33) 

min (0, 0) 



min(0, 1) 


min 

(0, 0.33) 


'0 

0 

0.33 

0.33 

0.33 

0.33 

0.33' 



0 

0 

0.33 

0.67 

0.67 

0.67 

0.33 



0 

0 

0.33 

0.67 

1 

0.67 

0.33 


L x M = 

0 

0 

0.33 

0.67 

0.67 

0.67 

0.33 



0 

0 

0.33 

0.33 

0.33 

0.33 

0.33 



0 

0 

0 

0 

0 

0 

0 



0 

0 

0 

0 

0 

0 

0 



(10.17) 


(10.18) 


Several such statements would form a control strategy and would be linked by their 
union 


A — Ai + A2 + A3 + • • • + A„ 


(10.19) 


10.2.4 Fuzzy logic control 

The basic structure of a Fuzzy Logic Control (FLC) system is shown in Figure 10.7. 

The fuzzification process 

Fuzzification is the process of mapping inputs to the FLC into fuzzy set membership 
values in the various input universes of discourse. Decisions need to be made 
regarding 

(a) number of inputs 

(b) size of universes of discourse 

(c) number and shape of fuzzy sets. 

A FLC that emulates a PD controller will be required to minimize the error e(t) and 
the rate of change of error de/dt, or ce. 

The size of the universes of discourse will depend upon the expected range (usually 
up to the saturation level) of the input variables. Assume for the system about to be 
considered that e has a range of ±6 and ce a range of ± 1 . 

The number and shape of fuzzy sets in a particular universe of discourse is a trade- 
off between precision of control action and real-time computational complexity. In 
this example, seven triangular sets will be used. 
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Fig. 10.7 Fuzzy Logic Control System. 


Each set is given a linguistic label to identify it, such as Positive Big (PB), Positive 
Medium (PM), Positive Small (PS), About Zero (Z), Negative Small (NS), Negative 
Medium (NM) and Negative Big (NB). The seven set fuzzy input windows for e and 
ce are shown in Figure 10.8. If at a particular instant, e(t) = 2.5 and de/d t = —0.2, 
then, from Figure 10.8, the input fuzzy set membership values are 


Mps(e) = 0.7 /J PM (e) — 0.4 
A<Ns(ce) = 0.6 i-b(ce) = 0.3 


( 10 . 20 ) 


The fuzzy rulebase 

The fuzzy rulebase consists of a set of antecedent-consequent linguistic rules of 
the form 


IF e is PS AND ce is NS THEN u is PS (10.21) 

This style of fuzzy conditional statement is often called a ‘Mamdani’-type rule, after 
Mamdani (1976) who first used it in a fuzzy rulebase to control steam plant. 

The rulebase is constructed using a priori knowledge from either one or all of the 
following sources: 

(a) Physical laws that govern the plant dynamics 

(b) Data from existing controllers 

(c) Imprecise heuristic knowledge obtained from experienced experts. 

If (c) above is used, then knowledge of the plant mathematical model is not required. 

The two seven set fuzzy input windows shown in Figure 10.8 gives a possible 7x7 
set of control rules of the form given in equation (10.21). It is convenient to tabulate 
the two-dimensional rulebase as shown in Figure 10.9. 

Fuzzy inference 

Figure 10.9 assumes that the output window contains seven fuzzy sets with the same 
linguistic labels as the input fuzzy sets. If the universe of discourse for the control 
signal u(t) is ±9, then the output window is as shown in Figure 10.10. 
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Fig. 10.8 Seven set fuzzy input windows for error (e) and rate of change of error (ce). 

Assume that a certain rule in the rulebase is given by equation (10.22) 

OR IF e is A AND ce is B THEN u = C (10.22) 

From equation (10.5) the Boolean OR function becomes the fuzzy max operation, 
and from equation (10.6) the Boolean AND function becomes the fuzzy min oper- 
ation. Hence equation (10.22) can be written as 

He (m) = max[min(/iA(e), hb ( ce))] (10.23) 

Equation (10.23) is referred to as the max-min inference process or max-min fuzzy 
reasoning. 

In Figure 10.8 and equation (10.20) the fuzzy sets that were ‘hit’ in the error input 
window when e(t) = 2.5 were PS and PM. In the rate of change input window when 
ce = —0.2, the fuzzy sets to be ‘hit’ were NS and Z. From Figure 10.9, the relevant 
rules that correspond to these ‘hits’ are 
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Fig. 10.9 Tabular structure of a linguistic fuzzy rulebase. 



Control Signal (u) 

Fig. 10.10 Seven set fuzzy output window for control signal ( u ). 


OR IF e is PS AND ce is NS 
OR IF e is PS AND ce is Z 

THEN u = PS (10.24) 

OR IF e is PM AND ce is NS 
OR IF e is PM and ce is Z 

THEN u = PM (10.25) 
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Applying the max-min inference process to equation (10.24) 

yaps(w) = max[min(|Ups(e), Mns(«0), min(/zp S (e), nz(ce))\ (10.26) 

inserting values from equation (10.20) 

Mps(«) = max[min(0.7, 0.6), min(0.7, 0.3)] 

= max[0.6, 0.3] = 0.6 (10.27) 

Applying the max-min inference process to equation (10.25) 

/Jpm(w) = max[min(/rpM (<?), At N s(ce)), min(/x PM (e), /i z(ce))\ (10.28) 

inserting values from equation (10.20) 

Mpm(m) = max[min(0.4, 0.6),min(0.4, 0.3)] 

= max[0.4, 0.3] = 0.4 (10.29) 

Fuzzy inference is therefore the process of mapping membership values from the 
input windows, through the rulebase, to the output window(s). 


The defuzzification process 

Defuzzification is the procedure for mapping from a set of inferred fuzzy control 
signals contained within a fuzzy output window to a non-fuzzy (crisp) control signal. 
The centre of area method is the most well known defuzzification technique, which in 
linguistic terms can be expressed as 


Crisp control signal 


Sum of first moments of area 
Sum of areas 


(10.30) 


For a continuous system, equation (10.30) becomes 

„(,) = 

J /j,(n)au 


(10.31) 


or alternatively, for a discrete system, equation (10.30) can be expressed as 


u(kT ) 


E"=i 

E"=i 


(10.32) 


For the case when e(t) = 2.5 and ce = —0.2, as a result of the max-min inference 
process (equations (10.27) and (10.29)), the fuzzy output window in Figure 10.10 is 
‘clipped’, and takes the form shown in Figure 10.11. 

From Figure 10.1 1, using the equation for the area of a trapezoid 


, 0.6(6 + 2.4) „ „ 

Areaps = — = 2.52 

. 0.2(6 + 3.6) 

AreapM = = 0.96 


(10.33) 


From equation (10.30) 


■■W- (2 52 C3» + ^ X6) = 3,3 


2.52 + 0.96 


(10.34) 
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Control Signal (u) 

Fig. 10.11 Clipped fuzzy output window due to fuzzy inference. 


Hence, for given error of 2.5, and a rate of change of error of —0.2, the control signal 
from the fuzzy controller is 3.83. 

Example 10.2 

For the input and output fuzzy windows given in Figure 10.8 and 10.10, together 
with the fuzzy rulebase shown in Figure 10.9, determine 

(a) the membership values of the input windows e and ce. 

(b) the max-min fuzzy inference equations 

(c) the crisp control signal u{t ) 

when e = — 3 and ce = 0.3 
Solution 

(a) When e = — 3 and ce = 0.3 are mapped onto the input fuzzy windows, they are 
referred to as fuzzy singletons. From Figure 10.8 

e = — 3 /tns(c) = 0.5 /tnm (c) = 0.5 (10.35) 

ce = 0.3, using similar triangles 

1 _ /iz (ce) 

0.33 “(0.33 -0.3) 

Hz (ce) = 0.09 (10.36) 

and 

1 _ Mps (ce) 

0.33 “ 0.3 

Ups (ce) = 0.91 (10.37) 
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(b) The rules that are ‘hit’ in the rulebase in Figure 10.9 are 

. . . OR IF e is NS and ce is Z 
OR IF e is NS and ce is PS 

THEN u = NS (10.38) 

. . . OR IF e is NM and ce is Z 
OR IF e is NM and ce is PS 

THEN u = NM (10.39) 

Applying max-min inference to equation (10.38) 

Mns(») = max[ min(/t NS (e), l-iz(ce)), min(/j NS (e), /xps («?))] (10.40) 

Inserting values into (10.40) 

/jns(m) = max[min(0.5, 0.09), min(0.5, 0.91)] 

= max[0.09, 0.5] = 0.5 

and similarly with equation (10.39) 

Mnm(«) = max[min( / u N M(e),/xz(ce)),min( / u NM (e),/ups(ce))] 

= max[min(0.5, 0.09),min(0.5, 0.91)] 

= max[0.09, 0.5] = 0.5 

Using equations (10.41) and (10.42) to ‘clip’ the output window in Figure 10.10, the 
output window is now as illustrated in Figure 10.12. 

(c) Due to the symmetry of the output window in Figure 10.12, from observation, 
the crisp control signal is 

u(t) = —4.5 


(10.41) 


(10.42) 


Example 10.3 (See also Appendix 1, examp 103. m) 

Design a fuzzy logic controller for the inverted pendulum system shown in Figure 
10.13 so that the pendulum remains in the vertical position. 

The inverted pendulum problem is a classic example of producing a stable closed- 
loop control system from an unstable plant. 

Since the system can be modelled, it is possible to design a controller using the pole 
placement techniques discussed in Chapter 8. Neglecting friction at the pivot and the 
wheels, the equations of motion from Johnson and Picton (1995) are 


F + m£(0 2 sin 9 — 9 cos 9) 
M + m 


(10.43) 


g sin 9 + cos 9 ( F M+l? m6 ) 


n( 4 m cos 2 0 \ 

c \3 M+m ) 


(10.44) 
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Control Signal (u) 

Fig. 10.12 Fuzzy output window for Example 10.2. 



Fig. 10.13 An inverted pendulum. 

In equations (10.43) and (10.44), m is the mass and l is the half-length of the 
pendulum and M is the mass of the trolley. F(t) is the applied force to the trolley 
in the x-direction. If it is assumed that 8 is small and second-order terms ( 9 2 ) can be 
neglected, then 


F — ml§ 
M + m 



(10.45) 


(10.46) 
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If the state variables are 

xi = 9, %2 = 0, xi = x and X 4 = x 

and the control variable is 

u = F(t) 

then from equations (10.45) and (10.46), the state equations become 

,\'i 0 1 0 0 x\ 0 

X2 _ «21 0 0 0 X-2 b2 

X 3 - 6 0 0 1 *3 + 0 " “ 


(10.47) 


where 


[041 0 0 Oj L-V4J \_b 4 

3 g(M + m ) 
l{4 (M + m) — 3m} 

—3 gm 

4 (M + m) — 3m 
-3 

1}4{M + m) — 3m} 


(10.48) 


h 4 = 

and the output equation is 


M + m) ( 4 (M + m) — 3m 


(10.49) 


y = Cx ( 

where C is the identity matrix. For a regulator, with a scalar control variable 

u = — Kx 


The elements of K can be obtained by selecting a set of desired closed-loop poles as 
described in section 8.4.2, and applying one of the three techniques discussed. 

Data for simulation 

£ = I m M = 1 kg m = 0.5 kg 
3x9.81(1.5) 

° 21 = 1{(4 x 1.5) — 1.5} = 9-81 

-3x9.81x0.5 
° 41 - (4 x 1.5)- 1.5 " “ 3 '“ 7 

h = 1{(4 x L5) — 1.5} = -° M1 


1.5y) \ 1 + (4 x 1.5)- 1.5 


= 0.889 
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If the required closed-loop poles are 
s = — 2 ± j2 for the pendulum, and 

s = — 4 ± j4 for the trolley, then the closed-loop characteristic equation is 

/ + 12s 3 + 12s 1 + 192s + 256 = 0 (10.50) 

Using Ackermann’s Formula in equations (8.103) and (8.104), the state feedback 
matrix becomes 


K = [-174.83 —57.12 -39.14 -29.36] (10.51) 

Using the fuzzy logic approach suggested by Johnson and Picton (1995), four, 
three set input windows (one for each state variable) and one, three set output 
window has been selected as shown in Figure 10.14. Using heuristic knowledge from 
broom-balancing experiments, the following Mamdani-type rulebase was con- 
structed: 


1 . IF 9 is PB and 9 is PB then F is PB 

2. IF 9 is PB and 9 is Z then F is PB 

3. IF 9 is PB and 9 is NB then F is Z 

4. IF 9 is Z and 9 is PB then F is PB 

5. IF 9 is Z and 9 is Z then F is Z 

6. IF 9 is Z and 9 is NB then F is NB (10.52) 

7. IF 9 is NB and 9 is PB then F is Z 

8. IF 9 is NB and 9 is Z then F is NB 

9. IF 9 is NB and 9 is NB then F is NB 

10. IF 9 is PB then F is PB 

11. IF 9 is NB then F is NB 

The rulebase can be extended up to 22 rules by a further set of 1 1 rules replacing 9 
with x and 9 with x. 

For the rulebase given in equation (10.52), the fuzzy max-min inference process is 

Mpb(«) = max[/j PB (0), min(/j PB (<9), Mpb(#)X min(/Lt PB (0), Hz0)), min(/z z (6>), // PB (0))] 
Mnb(m) = max[/j NB (0), min (p z {9), /i N r(9)), min (/i NB (0), IJ-z(9)), min(/i NB (<9), Mnb( 0))] 
Mz (m) = max[min(/i PB (6>), /r NB (0)), min(/i Z (0), /z z (0)), min(/x N B(<9), mpb(0))] 

Again, a similar inference process occurs with x and x. Following defuzzification, 
a crisp control force F(t) is obtained. 

Figure 10.15 shows the time response of the inverted pendulum state variables 
from an initial condition of 9 = 0.1 radians. On each graph, three control strategies 
are shown, the 11 set rulebase of equation (10.52), the 22 set rulebase that includes 
v and x, and the state feedback method given by equation (10.51). 

For the pendulum angle, shown in Figure 10.15(a), the 11 set rulebase gives the 
best results, the state feedback being oscillatory and the 22 set rulebase diverging 
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Fig. 10.14 Input and output fuzzy windows for the inverted pendulum problem. 


after a while. The same comments apply to the pendulum angular rate, given in 
Figure 10.15(b). 

With the trolley displacement and velocity shown in Figures 10.15(c) and (d), the 
state feedback, although oscillatory, give the best results since there is no steady-state 
error. The positional error for both rulebases increases with time, and there is a 
constant velocity steady-state error for the 1 1 set rulebase, and increasing error for 
the 22 set rulebase. Figure 10.15(e) shows the control force for each of the three 
strategies. 

The 11 and 22 set rulebase simulations were undertaken using SIMULINK, 
together with the fuzzy logic toolbox for use with MATLAB. More details on the 


Pendulum angular rate (rad/s) Pendulum angle (rad) 
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Trolley velocity (m/s) Trolley displacement (m/s) 
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(Fig. 10.15 continued) 
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Fig. 10.15 Inverted pendulum state variable time response for three control strategies. 


MATLAB Fuzzy Inference System (FIS) editor can be found in Appendix 1. Figure 
10.16 shows the control surface for the 11 set rulebase fuzzy logic controller. 


10.2.5 Self-organizing fuzzy logic control 

Self-Organizing Fuzzy Logic Control (SOFLC) is an optimization strategy to create 
and modify the control rulebase for a FLC as a result of observed system 
performance. The SOFLC is particularly useful when the plant is subject to time- 
varying parameter changes and unknown disturbances. 

Structure 

A SOFLC is a two-level hierarchical control system that is comprised of: 

(a) a learning element at the top level 

(b) a FLC at the bottom level. 

The learning element consists of a Performance Index (PI) table combined with a rule 
generation and modification algorithm, which creates new rules, or modifies existing 
ones. The structure of a SOFLC is shown in Figure 10. 17. With SOFLC it is usual to 
express the PI table and rulebase in numerical, rather than linguistic format. So, for 
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Fig. 10.16 Control surface for 11 set rulebase fuzzy logic controller. 



Fig. 10.17 Self-Organizing Fuzzy Logic Control system. 
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Fig. 10.18 Tabular structure of a numerical fuzzy rulebase. 


example, the fuzzy rulebase in Figure 10.9, might take the form as shown in Figure 
10.18. 

Rulebase modification 

If the numerical structure of the fuzzy rulebase does not give an acceptable response, 
then the values in certain cells will need to be adjusted. 

Let the error, rate of change of error and control signal at time t be e(t), ce(t) and 
u(t) respectively, and assume that a given PI is a function of e(t) and ce(t). 

If there are unacceptable errors at time t, because of the dynamics of the plant, 
these will be as a result of control action taken d seconds previously, or at time 
(t — d). The parameter d is a ‘delay in reward’ parameter and is related to the settling 
time of the plant, having a typical value of between 37" and 57", where T is the 
dominant time constant of the plant. 

The value of the PI is therefore determined using e(t — d) and ce(t — d) and applied 
to u{t) as a correction factor to the rulebase in the form 


IF e{t) is . . . and ce(t) is . . . THEN u(t) = ■ ■ ■ + PI (10.53) 


where the PI is read from a Performance Index table of the form shown in Figure 
10.19. When the values of e(t — d) and ce(t — d) are within an acceptable range, the 
PI tends to zero and the fuzzy rulebase settles down and convergence for the self- 
organizing process has been achieved. The PI table is usually designed heuristically, 
based upon an intuitive understanding of the learning process, and the trade-off 
between speed of learning and stability of the rulebase. 
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Fig. 10.19 Performance Index table. 


10.3 Neural network control systems 
10.3.1 Artificial neural networks 

The human brain is comprised of many millions of interconnected units, known 
individually as biological neurons. Each neuron consists of a cell to which is attached 
several dendrites (inputs) and a single axon (output). The axon connects to many 
other neurons via connection points called synapses. A synapse produces a chemical 
reaction in response to an input. The biological neuron ‘fires’ if the sum of the 
synaptic reactions is sufficiently large. The brain is a complex network of sensory 
and motor neurons that provide a human being with the capacity to remember, 
think, learn and reason. 

Artificial Neural Networks (ANNs) attempt to emulate their biological counter- 
parts. McCulloch and Pitts (1943) proposed a simple model of a neuron, and Hebb 
(1949) described a technique which became known as ‘Hebbian’ learning. Rosenblatt 
(1961), devised a single layer of neurons, called a Perceptron, that was used for 
optical pattern recognition. 

One of the first applications of this technology for control purposes was by 
Widrow and Smith (1964). They developed an ADaptive LINear Element 
(ADLINE) that was taught to stabilize and control an inverted pendulum. Kohonen 
(1988) and Anderson (1972) investigated similar areas, looking into ‘associative’ 
and ‘interactive’ memory, and also ‘competitive learning’. The back propagation 
training algorithm was investigated by Werbos (1974) and further developed by 
Rumelhart (1986) and others, leading to the concept of the Multi-Layer Perceptron 
(MLP). 
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Artificial Neural Networks have the following potential advantages for intelligent 
control: 

• They learn from experience rather than by programming. 

• They have the ability to generalize from given training data to unseen data. 

• They are fast, and can be implemented in real-time. 

• They fail ‘gracefully’ rather than ‘catastrophically’. 


10.3.2 Operation of a single artificial neuron 

The basic model of a single artificial neuron consists of a weighted summer and an 
activation (or transfer) function as shown in Figure 10.20. Figure 10.20 shows a 
neuron in the /th layer, where 

X] ... Xj are inputs 
Wj i . . . Wji are weights 
bj is a bias 

fj is the activation function 
y’j is the output 

The weighted sum sj is therefore 

N 

Sj(t) = WjiXiit) + bj 

i=i 

Equation (10.54) can be written in matrix form 

Sj(t) = Wj x + bj 

The activation function f(s) (where 5 is the weighted sum) can take many forms, some 
of which are shown in Figure 10.21. From Figure 10.21 it can be seen that the bias bj 
in equations (10.54) and (10.55) will move the curve along the j axis, i.e. effectively 


(10.54) 


(10.55) 



Fig. 10.20 Basic model of a single artificial neuron. 
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setting the threshold at which the neuron ‘fires’. So in the case of the hard-limiting 
function, if bj = 0, the neuron will ‘fire’ when Sj(t) changes from negative to positive. 

The sigmoid activation function is popular for neural network applications since it 
is differentiable and monotonic, both of which are a requirement for the back- 
propagation algorithm. The equation for a sigmoid function is 



(10.56) 


10.3.3 Network architecture 

Feedforward networks 

An ANN is a network of single neurons jointed together by synaptic connections. 
Figure 10.22 shows a three-layer feedforward neural network. 

The feedforward network shown in Figure 10.22 consists of a three neuron input 
layer, a two neuron output layer and a four neuron intermediate layer, called a 
hidden layer. Note that all neurons in a particular layer are fully connected to all 
neurons in the subsequent layer. This is generally called a fully connected multilayer 
network, and there is no restriction on the number of neurons in each layer, and no 
restriction on the number of hidden layers. 
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Fig. 10.21 Activation functions. 
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Fig. 10.22 Three-layer feedforward neural network. 


Feedback (recurrent) networks 

Recurrent networks are based on the work of Hopfield and contain feedback paths. 
Figure 10.23 shows a single-layer fully-connected recurrent network with a delay 
(z _1 ) in the feedback path. 

If, in Figure 10.23, the inputs occur at time (kT) and the outputs are predicted at 
time (k + 1 ) T, then the network can be represented in matrix form by 

y (k + 1 )T = Wiy (kT) + W 2 \(kT) (10.57) 

Equation (10.57) is in the same form as the discrete-time solution of the state 
equation (8.76). 


10.3.4 Learning in neural networks 

Learning in the context of a neural network is the process of adjusting the weights 
and biases in such a manner that for given inputs, the correct responses, or outputs 
are achieved. Learning algorithms include: 

(a) Supervised learning-. The network is presented with training data that represents 
the range of input possibilities, together with the associated desired outputs. The 
weights are adjusted until the error between the actual and desired outputs meets 
some given minimum value. 

(b) Unsupervised learning-. Also called open-loop adaption because the technique 
does not use feedback information to update the network’s parameters. Applica- 
tions for unsupervised learning include speech recognition and image compres- 
sion. Important unsupervised networks include the Kohonen Self-Organizing 
Map (KSOM) which is a competitive network, and the Grossberg Adaptive 
Resonance Theory (ART), which can be used for on-line learning. 
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Fig. 10.23 Recurrent neural network. 


10.3.5 Back-Propagation 

The Back-Propagation Algorithm (BPA) is a supervised learning method for training 
ANNs, and is one of the most common forms of training techniques. It uses a 
gradient-descent optimization method, also referred to as the delta rule when applied 
to feedforward networks. A feedforward network that has employed the delta rule 
for training, is called a Multi-Layer Perceptron (MLP). 

If the performance index or cost function J takes the form of a summed squared 
error function, then 


, M 

J = ~ yrf 


3 = 1 


(10.58) 


where dj and y,- are the desired and actual network outputs respectively. Using 
gradient-descent, the weight increment Any is proportional to the (negative) slope 


. dJ 

Any = -p — 
dwu 


where p is a constant. From equations (10.58) and (10.59), 


dJ 

dwji 



(10.59) 
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using the chain rule, 


giving 


\2 dyi 

dwfi j ' V ihvn 


dJ _ __ _ 2 _ ^ ,, _ . d)’j 
dwj~ Mj^ (j yj, d Wji 


(10.60) 


If the activation function is the sigmoid function given in equation (10.56), then its 
derivative is 


df Q~ s ’ 1 / 1 \ 2 

dsj (1 + e~ s J) 2 1 + z~ Sj \1 + e~ s J J 

or 

=f(s)-f(s ) 2 (10.61) 

Since f(s) is the neuron output v/, then equation (10.61) can be written as 


9yj 

dsj 


Mi -yj) 


From equation (10.60), again using the chain rule. 


(10.62) 


dy’j dyj dsj 

dwji dsj dwji 


(10.63) 


If, in equation (10.54), the bias bj is called H’/o, then equation (10.54) may be 
written as 


thus 


Sj 


N 


Y w J iXi 

i = 0 


(10.64) 


dsj d v ' x dwn 

i)U -. = Wj ‘ Xi = ^ V/ " 


dw Ji dw j . i=0 


i=0 dw J> 


(10.65) 


Substituting equations (10.62) and (10.65) into (10.63) gives 
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Putting equation (10.66) into (10.60) gives 


J 7=1 


(10.67) 


or 


where 


dJ 

dwji 


2 

M 


M 


7=1 


<-/ = ( 4 - - v /).':/( 1 - 37 ) 

Substituting equation (10.68) into (10.59) gives 

M 

Awjj = n^s jXi 

7=1 


(10.68) 


(10.69) 


(10.70) 


where 


This leads to a weight increment, called the delta rule, for a particular neuron 

A Wji(kT) = rjbjXi (10.71) 

where ij is the learning rate and has a value of between 0 and 1 . Hence the new weight 
becomes 


Wji(kT) = wji(k - 1 )T + Awji(kT) 


or 


Wjj(kT) = wji(k -1)7’ + ijSjXi 


(10.72) 


Consider a three layer network. Let the input layer be layer one (£ = 1), the hidden 
layer be layer two (£ = 2) and the output layer be layer three (i = 3). The back- 
propagation commences with layer three where dj is known and hence 6j can be 
calculated using equation (10.69), and the weights adjusted using equation (10.71). 
To adjust the weights on the hidden layer (£ = 2) equation (10.69) is replaced by 



[M 1 — 37')] n 


N 

J2 w J i6 J 


e+\ 


(10.73) 
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Hence the 6 values for layer £ are calculated using the neuron outputs from layer l 
(hidden layer) together with the summation of w and 6 products from layer £ + 1 
(output layer). The back-propagation process continues until all weights have been 
adjusted. Then, using a new set of inputs, information is fed forward through the 
network (using the new weights) and errors at the output layer computed. The 
process continues until 

(i) the performance index J reaches an acceptable low value 

(ii) a maximum iteration count (number of epochs) has been exceeded 

(iii) a training-time period has been exceeded. 

For either (ii) or (iii), it may well be that a local minima has been located. Under these 
conditions the BPA may be re-started, and if again unsuccessful, a new training set 
may be required. 

The equations that govern the BPA can be summarized as 
Single neuron summation 

N 

sj = 22 w fl x i + b j (10.74) 

i= 1 


Sigmoid activation function 



" = l+e-* 

(10.75) 

Delta rule 

A Wji(kT) = rj6jXj 

(10.76) 

New weight 

Wji(kT) = wji(k - 1 )T + Awjj(kT) 

(10.77) 

Output layer 

A = •>/( 1 - .'7)0// - yj) 

(10.78) 


Other layers 


i M 

7=1 


Pi\ t = [M 1 -yj)] 


' N 

22 wjiSj 


L /=1 


7+1 


(10.79) 


(10.80) 


Learning with momentum 

When momentum is used in the BPA, the solution stands less chance of becoming 
trapped in local minima. It can be included by making the current change in weight 
equal to a proportion of the previous weight change summed with the weight change 
calculated using the delta rule. 
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The delta rule given in equation (10.76) can be modified to include momentum as 
indicated in equation (10.81). 


Awjj(kT) = (1 — a)r]8jXj + aAwp(k — 1)7” (10.81) 

where a is the momentum coefficient, and has a value of between 0 and 1 . 


Example 10.4 

The neural network shown in Figure 10.24 is in the process of being trained using a 
BPA. The current inputs x\ and x 2 have values of 0.2 and 0.6 respectively, and the 
desired output dj = 1 . The existing weights and biases are 
Hidden layer 



'1.0 

1.5' 


1.0 ' 

w J = 

0.5 

2.0 

b / = 

-0.5 


2.5 

3.0 

1.5 


Vi 



Fig. 10.24 Training using back-propagation. 
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Output layer 

Wy = [3.0 2.0 1.0] by = [-4.0] 

Calculate the output yj and hence the new values for the weights and biases. Assume 
a learning rate of 0.5. 

Solution 


Forward propagation 

Hidden layer (l = 1): Single neuron summation 


7=1: 
7 = 2: 
7 = 3: 
or 

’•0 ' 

Si = 

_S3_ 

Sigmoid activation functions ( j 


51 = w 10 + W nXi + H’12.\'2 

5 2 = W 2 0 + W 2 \X\ + W22*2 

53 = M’30 + W 31 X 1 + H’32.\'2 


~W U 

W 12 


Xl 

_X 2 _ 


’who" 

W 21 

H’22 


+ 

W ; 20 

_H’3i 

H’32 _ 



. tV 30 _ 


1 to 3) 


y 1 


1 

1 + e _?1 


J2 


1 


1 + e~« 


J 3 


1 

1 + e-« 


Output layer (£ = 2) 


7=1: Si = H ’10 + w U }’i + w 12 .V 2 + W 13 .V 3 

1 


Inserting values into equations (10.82) and (10.83) 


’•Si" 

Si 



'1.0 

0.5 

1.5' 

2.0 

'0.2' 

0.6 

+ 

' 1.0 ' 
-0.5 

_*S3 _ 


2.5 

3.0 


1.5 


si = 2.1 S 2 = 0.8 S 3 = 3.8 

y 1 = 0.891 j 2 = 0.690 y } = 0.978 


Inserting values into equations (10.84) and (10.85) 

si = 1.031 yj = yi= 0.737 


Back propagation 

Output layer (£ = 2): From equation (10.69) 

= .> 7 ( I - yj)(dj - V/) 


Since j = 1 


61 = 0.737(1 - 0.737)0 - 0.737) 
= 0.051 


(10.82) 


(10.83) 

(10.84) 

(10.85) 


( 10 . 86 ) 


(10.87) 
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Delta rule 

A Wjj(kT) = itfjXj 

Awio = 0.5 x 0.051 x 1 = 0.0255 
Awn = 0.5 x 0.051 x 0.891 = 0.0227 
Aw n = 0.5 x 0.051 x 0.69 = 0.0176 
Am’o = 0.5 x 0.051 x 0.978 = 0.0249 

New weights and biases for output layer 

w y = [3.0227 2.0176 1.0249] by = [-3.975] (10.88) 

Hidden layer (£ = 1): From equation (10.80) 

[ s j\e = [M 1 -yj)] t H W A 

-7 =l \ t + \ 

To illustrate this equation, had there been two neurons in layer (£ + 1), i.e. the output 
layer, then values for b\ and bn for layer {£ + 1) would have been calculated. Thus, for 
layer l (the hidden layer), the [bj\ values would be 

j = 1 : [^ = Lvi(l - Vi)]f[w’n6i + W 2 \b 2 ] t+ \ 

j = 2: [b 2 ] t = Lv 2 ( 1 — >’2)]f[M’l2^1 + W ; 22^2]^+l 

j = 3: [b-i\f = [ 323(1 — V3)]f [vi’13^1 + H’23^2]r4 I 

However, since in this example there is only a single neuron in layer (£ + 1 ), b 2 = 0. 
Thus the b values for layer i are 

7=1: [b { ] e = [0.891(1 - 0.891 )][3.0227 x 0.051] = 0.015 

j = 2: [b 2 ] e = [0.690(1 - 0.690)][2.0176 x 0.051] = 0.022 (10.89) 

j = 3: [^,]r = [0.978(1 - 0.978)][1 .0249 x 0.051] = 0.001 

Hence, using the delta rule, the weight increments for the hidden layer are 

Ah ’ 10 = 0.5 x 0.015 x 1 = 0.0075 
Awn = 0.5 x 0.015 x 0.2 = 0.0015 
Ah ’] 2 = 0.5 x 0.015 x 0.6 = 0.0045 
Ah ’20 = 0.5 x 0.022 x 1 = 0.0110 
Ah’ 2 i = 0.5 x 0.022 x 0.2 = 0.0022 
Am ’ 22 = 0.5 x 0.022 x 0.6 = 0.0066 
Ah’ 3 o = 0.5 x 0.001 x 1 = 0.0005 
Ah’ 3 i = 0.5 x 0.001 x 0.2 = 0.0001 
Air 3 2 = 0.5 x 0.001 x 0.6 = 0.0003 
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The new weights and biases for the hidden layer now become 


'1.0015 

1.5045' 


' 1.0075 ' 

0.5022 

2.0066 

b / = 

-0.489 

2.5001 

3.0003 


1.5005 


(10.90) 


10.3.6 Application of neural networks to modelling, estimation 
and control 

An interesting and important feature of a neural network trained using back-propa- 
gation is that no knowledge of the process it is being trained to emulate is required. 
Also, since they learn from experience rather than programming, their use may be 
considered to be a ‘black box’ approach. 

Neural networks in modelling and estimation 

Providing input/output data is available, a neural network may be used to model the 
dynamics of an unknown plant. There is no constraint as to whether the plant is 
linear or nonlinear, providing that the training data covers the whole envelope of 
plant operation. 

Consider the neural network state observer shown in Figure 10.25. This is similar 
in operation to the Luenberge full-order state observer given in Figure 8.9. If the 
neural network in Figure 10.25 is trained using back-propagation, the algorithm will 
minimize the PI 


N 

J = J2 (y( kT ) ~ y(kT)) J (y(kT) - y(kT)) (10.91) 

fc= l 

Richter et al. (1997) used this technique to model the dynamic characteristics 
of a ship. The vessel was based on the Mariner Hull and had a length of 161 m 
and a displacement of 1 7 000 tonnes. The training data was provided by a three 
degree-of-freedom (forward velocity, or surge, lateral velocity, or sway and turn, or 



Fig. 10.25 Neural network state observer. 
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yaw-rate) differential equation model produced by Burns and was based on previous 
work by Morse and Price. 

The training file consisted of input data of the form: Time elapsed t(kT ), Rudder 
angle 6(kT), Engine speed n(kT) with corresponding output data Forward velocity 
u{kT), Lateral velocity v(kT), Yaw-rate r(kT). 

With the engine speed held constant, the rudder was given step changes of 0°, 
±10°, ±20° and ±30°. Figure 10.26 shows training and trained data for a rudder 
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Fig. 10.26 Training and trained data fora neural network model of a Ship's Hull. 

angle of +20° (where positive is to port, or left). The input and output data was 
sampled every 5 seconds, during the transient period of the turn (0-300 seconds). 

The selected network had a 3-6-6-6-3 structure, i.e. input and output layers 
comprising 3 neurons in each, separated by three hidden layers of 6 neurons. During 
learning, 4 million epochs were trained. The learning rate and momentum were 
initially set at 0.3 and 0.8, but were reduced in three steps to final values of 0.05 
and 0.4 respectively. 

Inverse models 

The inverse model of a plant provides a control vector u (kT) for a given output 
vector y (kT) as shown in Figure 10.27. 



Fig. 10.27 Neural network plant inverse model. 
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Fig. 10.28 Training a neural network controller. 

So, for example, with the ship model shown in Figure 10.26, the inverse model could 
be trained with time, forward velocity, lateral velocity and yaw-rate as input data and 
rudder angle and engine speed as output data. 

Neural networks in control 

Controller emulation'. A simple application in control is the use of neural networks to 
emulate the operation of existing controllers. It may be that a nonlinear plant 
requires several tuned PID controllers to operate over the full range of control 
actions. Or again, an LQ optimal controller has difficulty in running in real-time. 
Figure 10.28 shows how the control signal from an existing controller may be used to 
train, and to finally be replaced by, a neural network controller. 

Error back-propagation through plant model 

All closed-loop control systems operate by measuring the error between desired 
inputs and actual outputs. This does not, in itself, generate control action errors that 
may be back-propagated to train a neural network controller. If, however, a neural 
network of the plant exists, back-propagation through this network of the system 
error (r (kT) — y (kT)) will provide the necessary control action errors to train the 
neural network controller as shown in Figure 10.29. 

Internal Model Control (IMC) 

Internal Model Control was discussed in relation to robust control in section 9.6.3 
and Figure 9.19. The IMC structure is also applicable to neural network control. The 
plant model G m (F) in Figure 9.19 is replaced by a neural network model and the 
controller C(s ) by an inverse neural network plant model as shown in Figure 10.30. 


10.3.7 Neurofuzzy control 

Neurofuzzy control combines the mapping and learning ability of an artificial neural 
network with the linguistic and fuzzy inference advantages of fuzzy logic. Thus 
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Fig. 10.30 Application of neural networks to IMC. 

a neurofuzzy controller has the potential to out-perform conventional ANN or fuzzy 
logic controllers. The general architecture of a neurofuzzy scheme is to employ neural 
network learning to upgrade either the membership functions or rulebase of the fuzzy 
logic element. 

The Adaptive Network based Fuzzy Inference System (ANFIS) 

The ANFIS neurofuzzy controller was implemented by Jang (1993) and employs 
a Takagi-Sugeno-Kang (TSK) fuzzy inference system. The basic ANFIS architecture 
is shown in Figure 10.31. 

Square nodes in the ANFIS structure denote parameter sets of the membership 
functions of the TSK fuzzy system. Circular nodes are static/non-modifiable and 
perform operations such as product or max/min calculations. A hybrid learning rule 
is used to accelerate parameter adaption. This uses sequential least squares in the 
forward pass to identify consequent parameters, and back-propagation in the back- 
ward pass to establish the premise parameters. 
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Layer 1 Layer 2 Layer 3 Layer 4 Layer 5 

(Premise Parameters) (Consequent Parameters) 



Fig. 10.31 TheAdaptive Network based Fuzzy Inference System (ANFIS) architecture (after Craven). 


If the fuzzy inference system has inputs x\ and X 2 and output / as shown in Figure 
10.31, then a first-order TSK rulebase might be 

Rule 1 : If is A\ and X 2 is B\ 

then /i = p\X\ + q\X 2 + >'\ 

Rule 2 : If jvti is A 2 and X 2 is Bi 

then /2 = P 2 X 1 + q 2 X 2 + r 2 

Rule n : If x\ is A n and xj is B„ 

then f n = p n x 1 + q„x 2 + r n (10.92) 

Where A\ . . . A„, B\ . . . B„ are membership functions and p\ . . ,p ni q\ . . . q n and 
ri . . . r„ are constants within the consequent functions. 

Layer 1 contains adaptive nodes that require suitable premise membership func- 
tions (triangular, trapezoidal, bell, etc). Hence 

y\,i = Ms i(xi) (10.93) 

Layer 2 undertakes a product or T-norm operation. 

V2,i = Wi = i-iAi(x] )/i/j,(x 2 ) . . . Ppi{x n ) i = 1, 2 . . . , n (10.94) 

Layer 3 calculates the ratio of the firing strength of the rules 
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Layer 4 generates the linear consequent functions as given in equation (10.92). Layer 
5 sums all incoming signals 


n V ' 77 

ys,i =f = yz™if = 


Wj f 


i= 1 


El 


Wi 


(10.96) 


A limitation of the ANF1S technique is that it cannot be employed on multivariable 
systems. The Co-active ANFIS (CANFIS) developed by Craven (1999) extends the 
ANFIS architecture to provide a flexible multivariable control environment. This 
was employed to control the yaw and roll channels of an Autonomous Underwater 
Vehicle (AUV) simultaneously. 

Predictive Self-Organizing Fuzzy Logic Control (PSOFLC) 

This is an extension of the SOFLC strategy discussed in section 10.2.5 and illustrated 
in Figure 10.17. Predictive Self-Organizing Fuzzy Logic Control is particularly useful 
when the plant dynamics are time-varying, and the general architecture is shown in 
Figure 10.32. 

In Figure 10.30 the predictive neural network model tracks the changing dynamics 
of the plant. Following a suitable time delay, e m (kT ) is passed to the performance 
index table. If this indicates poor performance as a result of changed plant dynamics, 
the rulebase is adjusted accordingly. Richter (2000) demonstrated that this technique 
could improve and stabilize a SOFLC when applied to the autopilot of a small 
motorized surface vessel. 



Fig. 10.32 Predictive Self-Organizing Fuzzy Logic Control (PSOFLC). 
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10.4 Genetic algorithms and their application to control 
system design 

10.4.1 Evolutionary design techniques 

In any design problem there is a multi-dimensional space of possible solutions. Some 
of these solutions may be acceptable, but not the best (local optima) and there may 
exist a single best solution (global optimum). 

It has been shown in Chapter 9 that it is possible to obtain an optimal mathemat- 
ical solution for a control system with linear plant dynamics. An alternative 
approach is to use ‘heuristics’, or knowledge acquired through experience, to search 
for optimal solutions. One such technique is to employ a Genetic Algorithm (GA). 
This is a search algorithm based upon the evolutional process of natural selection of 
the fittest members of a given population to breed the next generation. 


10.4.2 The genetic algorithm (GA) 

In the early 1960s Rechenburg (1965) conducted studies at the Technical University 
of Berlin in the use of an evolutionary strategy to minimize drag on a steel plate. 
Genetic algorithms were used by Holland (1975) and his students at the University of 
Michigan in the late 1970s and early 1980s to analyse a range of engineering 
problems. In particular, Goldberg (1983) used GAs to optimize the design of gas 
pipeline systems. 

The basic element of a GA is the chromosome. This contains the genetic inform- 
ation for a given solution and is typically coded as a binary string. For example, an 
eight digit binary number such as 11001001 represents a chromosome that contains 
eight genes. Initially, a population of chromosomes, created randomly, represent 
a number of solutions to a given problem. 

A ‘fitness function’, which is in effect a performance index, is used to select the best 
solutions in the population to be parents to the offsprings that will comprise the next 
generation. The fitter the parent, the greater the probability of selection. This 
emulates the evolutionary process of ‘survival of the fittest’. Parents are selected 
using a roulette wheel method as shown in Figure 10.33. Here there are four 
candidate parents PI, P2, P3 and P4, having selection probabilities (front the fitness 
function) of 0.5, 0.3, 0.15 and 0.05 respectively. For the example in Figure 10.33, if 
the roulette wheel is spun four times, PI may be selected twice, P2 and P3 once, and 
P4 not at all. 

Offsprings are produced by selecting parent chromosomes for breeding, and cross- 
ing over some of the genetic material. The amount of genetic material passed from 
parent to offspring is dictated by the random selection of a crossover point as indicated 
in Figure 10.34, where PI and P2 are the parents, and 01 and 02 the offsprings. 

Mutation is allowed to occur in some of the offsprings, the amount being con- 
trolled by the mutation rate, typically a very small number. This results in the 
random change in a gene in an offspring, i.e. from 0 to 1 . 

The breeding of successive generations continues until all offsprings are acceptably 
fit. In some cases, all offsprings will eventually have the same genetic structure, 
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Fig. 10.33 Roulette wheel selection. 
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10 1 


Fig. 10.34 Genetic material transfer during breeding. 

representing a global optimum, or in other cases, several solutions, called clustering 
may evolve. In this latter case, the system designer makes the decision as to which is 
the best solution. 

Example 10.5 

A system has a fitness function 

7 = 1 + sin ax (10.97) 

as shown in Figure 10.35. Assume that the solution space has 31 values and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
The value of a in equation (10.97) is therefore 11.6° (0.203 rad). If the population has 
four members, spinning a coin (heads = 1 , tails = 0) produced the following initial 
population 

00101 11110 00001 00011 

Determine the offsprings from the initial generation and the subsequent generation. 
Solution 

From Figure 10.35 it can be seen that the optimal solution occurs when .\'i 0 = 8, or 
x 2 = 01000. 

Table 10.1 shows the selection of parents for mating from the initial population. If 
a random number generator is used to generate numbers between 0.0 and 1.0, then 
the cumulative probability values in Table 10.1 is used as follows: 

Values between 0 and 0.342, Parent 1 selected 
Values between 0.343 and 0.488, Parent 2 selected 
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Fig. 10.35 Fitness function for Example 10.5. 


Table 10.1 Selection of parents for mating from initial population 


Parent 

*2 

*10 

J =/(*) 

p = J/ZJ 

Cumulative 

probability 

Roulette 
wheel hits 

1 

00101 

5 

1.848 

0.342 

0.342 

2 

2 

11110 

30 

0.792 

0.146 

0.488 

1 

3 

00001 

1 

1.201 

0.222 

0.710 

0 

4 

00011 

3 

1.571 

0.290 

1.000 

1 

Total 



5.412 

1.000 


4 

Mean 



1.353 

0.250 


1 

Maximum 


1.848 

0.342 


2 


Values between 0.489 and 0.710, Parent 3 selected 
Values between 0.71 1 and 1.000, Parent 4 selected 

The random number generator produced the following values: 0.326, 0.412, 0.862 
and 0.067. Hence Parent 1 was selected twice, Parents 2 and 4 once and Parent 3 not 
at all. The selected parents were randomly mated with random choice of crossover 
points. The fitness of the first generation of offsprings is shown in Table 10.2. 

From Tables 10.1 and 10.2 the total fitness of the initial population was 5.412, 
whereas the total fitness of their offsprings was 5.956, an increase of 10%. Note that 
if each offspring was perfect, they would have a value of 8io, or OIOOO 2 , thus giving 
the maximum fitness that any population could have of 2 x 4 = 8.0. 

The next spin of the random number generator produced values: 0.814, 0.236, 
0.481 and 0.712, giving the roulette wheel hits shown in Table 10.2. 

The second generation of offsprings is shown in Table 10.3. From Table 10.3 the 
total fitness of the second generation of offsprings is 7.204, or an increase of 33% 
above the initial population. As things stand, since the two most significant binary 
digits in the second generation offsprings are 00, subsequent breeding will not 


368 Advanced Control Engineering 


Table 10.2 Fitness of first generation of offsprings 


Parent 

Breeding 

Offspring 

*2 

*10 

J = fix) 

p = JIT.J 

Cumulative 

probability 

Roulette 
wheel hits 

i 

001 

01 

X 

1 

00110 

6 

1.937 

0.325 

0.325 

i 

2 

111 

10 

2 

11101 

29 

0.600 

0.101 

0.426 

0 

1 

00 

101 

X 

3 

00011 

3 

1.571 

0.264 

0.690 

1 

4 

Total 

Mean 

Maximum 

00 

Oil 

4 

00101 

5 

1.848 

5.956 

1.489 

1.937 

0.310 

1.000 

0.250 

0.325 

1.000 

2 


Table 10.3 Fitness of second generation of offsprings 


Parent Breeding Offspring xj x \ o J — fix) 


1 

4 

3 

4 


00110 

00101 

00011 

oofoi 


1 

00101 

5 

1.848 

2 

00110 

6 

1.937 

3 

00101 

5 

1.848 

4 

00011 

3 

1.571 


Total 

Mean 

Maximum 


7.204 

1.801 

1.937 


produce strings greater than 00 111, or 7io ■ If all four offsprings had this value, then a 
total fitness for the population would be 7.953, which is close to, but not the ideal 
fitness of 8.0 as explained earlier. However, if mutation in a particular offspring 
changed one of the two most significant digits from 0 to 1, a perfect optimal value 
could still be achieved. Also to bear in mind, is the very limited size of the population 
used in this example. 

Example 10.6 

The block diagram for an angular positional control system is shown in Figure 10.36. 
The system parameters are: 

Amplifier gain Kf = 3.5 
Servomotor constant K 4 = 1 5 Nm/A 
Field resistance Rf = 20 fi 
Gear ratio n = 5 

Equivalent moment of inertia of motor and load I e = 1.3 kgm 2 
Sampling time T = 0.05 seconds. 

Using a GA with a population of 10 members, find the values of the controller gain 
K\ and the tachogenerator constant K 4 that maximizes the fitness function 

/ = 100 / { (WH - 9o(kT)) 2 T (10.98) 

' k= 0 

when the system is subjected to a unit step at time kT = 0. Perform the summation 
over a time period of 2 seconds ( N = 40). Allow a search space of 0-15 for K\ and 
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Fig. 10.36 Angular positional control system. 


0-1 for K 4 . Assume that the solution space has 255 values and that each solution 
can be represented by an eight digit binary string, the first four digits representing 
K\ and the second four representing K 4 . 


Solution 

The plant transfer function is 


0o , , K 2 K 3 n 

Z7 (s) = W 


(10.99) 


If the state variables are x\ = 9o(t) and x 2 = 9o{t) = xi, then the state equations 
become 


d'i 


r° 11 

Xl 


0 

x 2 


0 0 

_ x 2 

+ 

K 2 K 3 n 

[ Rde \ 


and the output equations 


'9 0 


1 

O' 

Xl 

9 0 _ 


0 

1 

X 2 _ 


Inserting values into the state equations 


X\ 


'0 

r 

Xl 


0 


_X 2 


0 

0 

. X 2. 

+ 

10.096 

u 


( 10 . 100 ) 


For a sampling time of 0.05 seconds, the discrete form of equation (10.100) is 


xi(k + 1 )T 


1 

0.05' 

xi (kT)' 

I 

'0.0126' 

_x 2 (k + 1 )T 


0 

1 

x 2 (kT ) 

~r 

0.5048 


From Figure 10.36 the control law is 

u(kT) = K\ (0,(kT) - Xi(kT)) - nK 4 x 2 (kT) 


( 10 . 101 ) 


( 10 . 102 ) 


where 9i(kT) = 1.0 for all kT > 0. 
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Hence values of K\ and K 4 generated by the GA are inserted into equation (10.102) 
and the control u(kT) used to drive the discrete plant equation (10.101). The fitness 
function / is updated at each sampling instant to give an overall value at the end of 
each simulation. For a population of 10 members, 10 simulations are required per 
generation. 

Since the required search space is K\ 0-15, K 4 0-1, the following are examples of 
population membership 


Ki 

k 4 





1111 

1111 


= 15 

k 4 = 

1 

0011 

0111 

Ki 

= 3 

k 4 = 

7/15 = 0.467 

1001 

1100 

Ki 

= 9 

k 4 = 

12/15 = 0.8 


Table 10.4 shows the parent selection for mating from a randomly seeded initial 
population. The random numbers (0-1) from the roulette wheel spins were: 0.145, 
0.422, 0.977, 0.339, 0.607, 0.419, 0.075, 0.027, 0.846, 0.047. 

The fitness of the first generation of offsprings is given in Table 10.5. Further 
breeding produced the sixth generation of offsprings given in Table 10.6. Inspection of 
Table 10.6 reveals that values of K\ = 15, K 4 = 0.333 produces a global maximum of 
J = 1065. Figure 10.37 shows the unit step response of the system in Example 10.6 for 

(a) the maximum of the first generation of offsprings (/ = 841 ) 

(b) the global maximum of the sixth generation of offsprings (/ = 1065) 

Use of Schemata (Similarity templates): As the progression through generations of 
solutions takes place, there evolves certain similarities between genes within chromo- 
somes. These similarities can be exploited using a similarity template or schema, that 
sits within a schemata framework. 

A schema employs a don’t care symbol so, for example, the sixth generation of 
offsprings in Table 10.6 could have employed the template 

111 ** 1 ** 

The use of schemata will aid the speed of convergence. 


Table 10.4 Parent selection from initial population for Example 10.6 


Parent 

Ki 

k 4 

J 

P = 7/E7 

Cumulative 

probability 

Roulette 
wheel hits 

ion 1001 

11 

0.600 

647 

0.157 

0.157 

4 

0100 1010 

4 

0.667 

233 

0.056 

0.213 

0 

0001 om 

1 

0.400 

112 

0.027 

0.240 

0 

1001 1010 

9 

0.667 

497 

0.122 

0.362 

1 

mo om 

14 

0.467 

923 

0.224 

0.586 

2 

0101 0001 

5 

0.067 

375 

0.092 

0.678 

1 

1001 1101 

9 

0.867 

18 

0.004 

0.682 

0 

0110 1101 

6 

0.867 

46 

0.011 

0.693 

0 

1101 1010 

13 

0.667 

691 

0.168 

0.861 

1 

0101 0100 

5 

0.267 

573 

0.139 

1.000 

1 

Total 



4115 

1.000 


10 

Mean 



411.5 

0.100 


1 

Maximum 



923 

0.224 


4 
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Table 10.5 Fitness of first generation of offsprings for Example 10.6 


Parent 


10111 1001 
1 1 1)0 0111 
0101 0001 
oioi qioo 
101111001 
1001 | 1010 
1101 1010 
ion lqoi 
1011 1001 
11110 0111 
Total 
Mean 
Maximum 


Offspring 

K t 

K, 

J 

101100111 

10 

0.467 

712 

1111 1001 

15 

0.600 

841 

0101 0100 

5 

0.267 

573 

0101 0001 

5 

0.067 

375 

101111010 

11 

0.667 

596 

1001 1001 

9 

0.600 

541 

1101 1001 

13 

0.600 

747 

ion lqio 

11 

0.667 

596 

1010 0111 

10 

0.467 

713 

mi looi 

15 

0.600 

841 


6535 

653.5 

841 


Table 10.6 Fitness of sixth generation of offsprings for Example 10.6 


Offspring 

Kx 

K a 

J 

1110 0101 

14 

0.333 

1030 

1111 0110 

15 

0.400 

1029 

1110 0100 

14 

0.267 

1021 

mi oioi 

15 

0.333 

1065 

nil oni 

15 

0.467 

970 

nil oioo 

15 

0.267 

1041 

1110 1000 

14 

0.533 

858 

1110 0111 

14 

0.467 

923 

nil iooo 

15 

0.533 

905 

nil oioi 

15 

0.333 

1065 

Total 



9907 

Mean 



990.7 

Maximum 



1065 



Fig. 10.37 Comparison between best first generation and best sixth generations solutions for Example 1 0.6. 
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Other applications of Genetic Algorithms 

(a) Optimal control'. Optimal control problems such as the linear quadratic regulator 
discussed in section 9.2 can also be solved using GAs. The discrete quadratic 
performance index given in equation (9.28) can be employed as a (minimum) 
fitness function directly. Alternatively, as shown in Example 10.6 the reciprocal 
of equation (9.28) provides a (maximum) fitness function. 

(b) Self-Organizing Fuzzy Logic Control'. Genetic Algorithms may be used to adapt 
both membership functions and rulebase structures in a SOFLC system. 

Figure 10.38 shows an input window with three triangular fuzzy sets NB, Z and 
PB. Each set is positioned in its regime of operation by the centre parameter c so that, 
for example, NB can only operate on the negative side of the universe of discourse. 
The width of each set is controlled by parameter w. 

The chromosome string could take the form 


[ci w i c 2 w 2 c 3 H’ 3 ] 


(10.103) 


02 



Fig. 10.38 Adaption of membership function features using genetic algorithms. 

If each parameter is a 4-bit string, the configuration in Figure 10.38 would be 
represented by 

[100011111000111110001111] (10.104) 


10.4.3. Alternative search strategies 

In addition to evolutionary search strategies such as GAs, there are a number of 
other search techniques that are employed for design optimization. 
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Simulated annealing 

The physical annealing process consists of heating a metal up to a prescribed 
temperature and then allowing it to cool slowly. During cooling, the molecules form 
crystals which are in a minimum energy condition. The metal, therefore, settles to 
a global minimum energy state. 

With simulated annealing, an energy term E is defined, which then becomes the 
performance index to be minimized. For a given energy change A E at temperature T. 
the probability P of accepting a solution is 

P = e ~ A£ / kr (10.105) 

where k is the Boltzmann constant. If the energy of the system has decreased, then the 
system may move to the new state, based on the probability given by equation 
(10.105). As cooling proceeds along a prescribed schedule, the system avoids local 
minima, and settles down to a global minimum energy state. 

Tabu search 

Like simulated annealing, tabu search is a technique designed to avoid the problem 
of becoming trapped in local optima. The procedure is basically hill-climbing, which 
commences at an initial solution and searches the neighbourhood for a better solu- 
tion. However, the process will recognize, and avoid areas of the solution space that 
it has already encountered, thus making these areas ‘tabu’. The tabu moves are kept 
in a finite list, which is updated as the search proceeds. 


10.5 Further problems 


Example 10.7 

A fuzzy logic controller has input and output fuzzy windows as shown in Figure 
10.39. The fuzzy rulebase is given in Figure 10.40. If defuzzification is by the centre of 
area method, calculate crisp control signals u(t) when the error e(t) and the rate of 
change of error ce(t) have the following values: 



e(t) 

ce(t ) 

[Answer z/(t)] 

(i) 

0 

-2 

-6.67 

(ii) 

—4 

-1 

-2.66 

(hi) 

1 

1.5 

3.01 

(iv) 

4 

-1.5 

0.106 


Note: For the centre of area method, use only those values inside the dotted lines in 
the output window. 

Example 10.8 

The angular positional control system shown by the block diagram in Figure 10.36 is 
to have the velocity feedback loop removed and controller K\ replaced by a fuzzy 
logic controller (FLC) as demonstrated by Barrett (1992). The inputs to the FLC 
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Fig. 10.39 Input and output fuzzy windows for Example 107. 


\ e 

ce\ 

NB 

z 

PB 

NB 

NB 

NB 

Z 

Z 

NB 

Z 

PB 

PB 

Z 

PB 

PB 


Fig. 10.40 Fuzzy rulebase for Example 10.7. 

are angular error e(kT) and rate-of-change of angular error ce(kT). The output from 
the FLC is a control signal u(kT). The input and output fuzzy windows have the 
same number of fuzzy sets, but different scales for the universes of discourse as 
shown in Figure 10.41. The fuzzy rulebase is given in Figure 10.42. If the state 
variables are 


x\ = 0 0 (t) 

X2 = d 0 (t) = X\ 
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Normalized Universe of Discourse 


-3-2-1 0 1 2 3 e{kT) 


-8 -6 -4 -2 0 2 4 6 8 ce(kT) 


—5 —4 —3 -2 — 1 0 1 2 3 4 5 u{kT) 

Fig. 10.41 Input and output fuzzy windows for Example 10.8. 


\ e 

ce \ 

NB 

NM 

NS 

ZE 

PS 

PM 

PB 

NB 

NB 

NB 

NM 

NS 

ZE 

PM 

PB 

NM 

NB 

NB 

NM 

NM 

PS 

PM 

PB 

NS 

NM 

NS 

NS 

NS 

PS 

PM 

PM 

ZE 

NM 

NS 

NS 

ZE 

PS 

PS 

PM 

PS 

NM 

NM 

NS 

PS 

PS 

PS 

PM 

PM 

NB 

NM 

NS 

PM 

PM 

PB 

PB 

PB 

NB 

NM 

ZE 

PS 

PM 

PB 

PB 


Fig. 10.42 Fuzzy rulebase for Example 10.8. 
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then the state and output equations for the plant are as given in equation (10.100) 


X\ 


‘0 

f 

X\ 

+ 

0 

X2 


0 

0 

x 2 


10.096 

'9 X ' 


‘l 

o’ 

X\ 



_o 2 _ 


0 

1 

X2 




(10.106) 


and, for a sampling time of 0.2 seconds, the discrete form of equation (10.106) is 


x, (k + 1 )T 


'1 

0.2' 

X\ (kT) 

I 

'0.2019' 

x 2 (k + 1 )T 


0 

1 

x 2 (kT ) 

~r 

2.0192 


u(kT) 


(10.107) 


If the system, which is initially at rest when kT = 0, is given a unit step input at this 
time, determine e(kT ), ce(kT), u(kT ), x\(kT) and xi(kT ) for values of kT = 0, 
0.2, 0.4 and 0.6 seconds. 

Assume that 


e(kT) = (6) - 9 0 ) = 1 - xi(kT) 

ce{kT ) = d/dt(9i — 9q ) 

d9\ d9o 
d? dt 

= ° "" la = ~ X2 ( kT > 


Solution 


Table 10.7 Solution to Example 10.8 


kT 

xAkT) 

X2(kT) 

e(kT ) 

ce(kT) 

u(kT) 

,vi(7'+ i)r 

x i{k + 1 )T 

0 

0 

0 

1 

0 

1.083 

0.2187 

2.187 

0.2 

0.2187 

2.187 

0.7813 

-2.187 

0.666 

0.7906 

3.532 

0.4 

0.7906 

3.532 

0.2094 

-3.532 

-1.32 

1.2305 

0.867 

0.6 

1.2305 

0.867 

—0.2305 

-0.867 

-0.511 

1.3007 

-0.165 


Example 10.9 

A neural network has a structure as shown in Figure 10.43. Assuming that all 
the activation functions are sigmoids, calculate the values of yn and V 22 when the 
inputs are 

(a) x\ = 0.3, X 2 = 0.5 

(b) x\ = 0.9, ,\' 2 = 0. 1 

when the weights and biases are 
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yi2 yz> 



Fig. 10.43 Neural network structure for Example 1 0.9. 
Hidden layer 


Output layer 


'1 

2 


' 2 ' 

3 

3 

b /i = 

-2 

2 

1 

1 



-2 1 
2 3 


b/2 = 


3 

-3 


Solution 

(a) yi 2 = 0.450, 722 = 0.862 

(b) V 12 = 0.405, J 22 = 0.906 

Example 10.10 

In Example 10.9(b), if the target values for the outputs are = 0 and J 22 = 1, 
calculate new values for the weights and biases using the back-propagation algo- 
rithm. Assume a learning rate of 0.5 with no momentum term. 
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Solution 

Output layer: 61 = -0.098, 62 = 0.008 (Equation 10.78) 

2.951 ' 
-2.996 

Hidden layer: <5i = 0.0016, 82 = 0.042, £3 = —0.003 (Equation 10.80) 



'1.0007 

2.00008' 


' 2.0008 ' 

W n = 

3.019 

3.0021 

b/i = 

-1.979 

1.999 

0.9999 

0.9985 


Wj2 = 


-3.047 -2.036 0.954 
1.004 2.003 3.004 


Example 10.11 

A system has a parabolic fitness function 

J=-x 2 + 2x (10.108) 

Using a genetic algorithm, find the value of x that maximizes J in equation (10.108). 
Assume that the solution space has 3 1 values in the range v = 0 to 2 and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
Let the population have four members and it is initially seeded by spinning a coin 


(heads = 

1, tails = 0). 



Solution 

x( 2 ) 

OHIO 01111 

10000 

10001 

x(10) 

14 15 

16 

17 

X 

0.903 0.968 

1.032 

1.097 

J 

0.990591 0.998976 

0.998976 

0.990591 


Hence x = 0.968 and 1 .032 both give optimum solutions. 

Example 10.12 

The closed-loop control system analysed by the root-locus method in Example 5.8 
can be represented by the block diagram shown in Figure 10.44. Using root-locus, the 
best setting for K\ was found to be 1 1.35, representing a damping ratio of 0.5. 


Proportional Plant 



Fig. 10.44 Block diagram for Example 5.8. 
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Validate, or otherwise, using a genetic algorithm that this value of K\ maximizes 
the fitness function 


lN - 1 


J = 100/ J2^r( kT ) - c(kT)) 2 T} 


(10.109) 


k = 0 


when the system is subjected to a unit step at time kT = 0. Using a sampling time 
T = 0.05 seconds, perform the summation over a time period of 10 seconds 
(N = 200). Allow a search space of 0-100 for K\. Assume that the solution space 
has 255 values and that each solution can be represented by an eight digit binary 
string chromosome. Use a randomly seeded initial population of 10 members. 

If the state variables are 

A'l = c(t) 
x 2 = c(t) = X\ 

A 3 = C(t) = X 2 

From Figure 10.44, the plant differential equation may be written as 

A 3 = OAl — 10A2 — 7 a 3 + U 
The plant state and output equations are then 


X\ 


'0 

1 

0 ' 


•U 


'O' 

*2 

= 

0 

0 

1 


*2 

+ 

0 

•*3 


0 

-10 

-7 


•U 


1 


C = [ 1 0 0]x (10.110) 

For a sampling time of 0.05 seconds, the discrete form of equation (10.110) is 


u(kT) 

(10.111) 


A] (k + 1 )T 


'1.0 

0.0498 

0.001 r 


x\{kT) 


'0.00002' 

x 2 (k + 1 )T 

= 

0.0 

0.9889 

0.0420 


x 2 (kT) 

+ 

0.00111 

a 3 (k+ 1 )T 


0.0 

-0.4201 

0.6948 _ 


a 3 (kT) 


0.04201 _ 


Solution 


A'l (2) 

00011101 

00101001 

00110011 

00111000 

10000001 

10110011 

Aj ( 10) 

29 

41 

51 

56 

129 

179 

A'l 

11.37 

16.08 

20.0 

21.96 

50.59 

70.20 

J 

112.99 

124.51 

126.63 

125.82 

48.18 

7.77 


Thus the value of K\ that maximizes the fitness function in equation (10.109) is 
K\ = 20.0. This produces an overshoot of 38% when kT = 2.0 seconds, and repre- 
sents an aj n of 1.847 rad/s and a ( of 0.303. 



Appendix 1 
Control system design 
using MATLAB 


A1.1 Introduction 

MATLAB, its Toolboxes and S1MUL1NK have become, over a number of years, the 
industry standard software package for control system design. The purpose of this 
Appendix is to introduce the reader to some of the more useful aspects of MATLAB, 
and to illustrate how the software may be used to solve examples given in the main 
text of the book. 


A1.1.1 Getting started 

The examples given in this Appendix were generated using MATLAB Version 5.3. 
Once the software has been installed, MATLAB is most easily entered by clicking the 
MATLAB icon. Alternatively, in a Windows environment, MATLAB can be entered 
by clicking the following sequence 

Start — ►Programs — ► MATLAB for Windows — ► MATLAB 5.3 

The user should now be in the MATLAB command window, which contains some 
helpful comments together with the MATLAB prompt » . MATLAB commands are 
typed after the prompt, and entered using ‘Return’ (or ‘Enter’). Terminating the 
command with will suppress the result of the command being printed in the 
command window. Comments are preceded by the *%’ symbol. 


A1.2 Tutorial 1: Matrix operations 

This tutorial introduces the reader to matrix operations using MATLAB. All text in 
courier font is either typed into, or printed into the command window. 


»% Matrix Operations 
»% To enter a matrix 
» A= [ 1 3 ; 5 9] ; 

» B= [ 4 -7; 10 0] ; 

» A 
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A= 

1 3 

5 9 

»B 
B = 

4 -7 

10 0 

»% Note that MATLAB is case sensitive 
»% Matrix Addition 

»A+B % Terminating with ' ; ' will suppress ' ans ' 
ans= 

5 -4 

15 9 

»% Matrix Multiplication 

»A*B 

ans= 

34 -7 

110 -35 

»% Determinant of a Matrix 

» det (A) 

ans= 

-6 

»% Inverse of a Matrix 

» inv (A) 

ans= 

-1.5000 0.5000 

0.8333 -0.1667 
» % Check 
» C = inv (A) ; 

» A*C 
ans= 

1.0000 0.0000 
0.0000 1.0000 
» % Solve A A -1*B 
»A\B 
ans= 

-1.0000 10.5000 
1.6667 -5.8333 
»% Solve A*B A -1 
» A/B 
ans= 

-0.4286 0.2714 
-1.2857 1.0143 
»% Eigenvalues of a Matrix 
» eig (A) 
ans= 

-0.5678 

10.5678 

»% Coefficients of Characteristic Equation (as A 2+bs+c) 

»poly (A) 

ans= 

1.0000 - 10.0000 - 6.0000 

»% Roots of Characteristic Equation ( as A 2+bs+c=0 ) 

» ce= [ 1 -10 -6] ; 

»roots(ce) 
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ans= 

10.5678 

- 0.5678 

»% Note that roots(ce) and eig(A) give the same result 
»% Transpose of a Matrix 
» A ' 
ans= 

1 5 

3 9 

»% Rank of a Matrix 

» r ank ( A ) 

ans= 

2 

»% Create an Identity Matrix 
» I=eye ( 3 ) ; 

»I 

1 = 

10 0 
0 10 
0 0 1 

»% Condition of a Matrix 

» % The higher the Condition Number , the more ill-conditioned the 
» % matr ix is 

»% LoglO of Condition Number gives approx, number of decimal 
» % places 

»% lost due to round-off errors 

» cond (A) 

ans= 

19.2815 

» % Tutorial End 

The above session may be printed by clicking 
File — ► Print 

MATLAB may be closed by clicking 
File— ►Exit MATLAB 


A1.3 Tutorial 2: Time domain analysis 

This tutorial introduces the reader to time domain analysis using MATLAB. It uses 
commands from the Control System Toolbox. A list of the commands can be found using 

»help control 

More information on individual commands can be obtained, for example 
»help step 

will provide more detail on how to use the step command. 

Script files'. A script file is an ASCII text file of MATLAB commands, that can be 
created using 
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(a) a text editor 

(b) the MATLAB editor/debugger 

(c) a word processor that can save as pure ASCII text files. 

A script file should have a name that ends in ‘.m’, and is run by typing the name of 
the file (without ‘.m’) after the MATLAB prompt, or by typing the sequence 

File — ► Run Script — ►enter file name 

The advantage of a script file is that it only needs to be created once and saves the 
labour of continually typing lists of commands at the MATLAB prompt. 

The examples given in this tutorial relate to those solved in Chapter 3. Consider 
a first-order transfer function 


G(s) =1/1 + 5 

The impulse response function (Example 3.4, Figure 3.11) can be created by the 
following script file 

File name: examp34.m 

% impulse response of transfer function G ( s ) =num ( s ) /den ( s ) 

%num and den contain polynomial coefficients 
%in descending power s of s 
c If 

num= [ 1 ] ; 
den=[ 1 1 ] ; 
impulse (num,den); 
grid; 

pr intsys ( num, den, 's' ) ; 

This shows how a transfer function is entered into MATLAB, where num = [l] is the 
numerator (K = 1) and den= [ 1 1] represents the ‘s’ coefficient and the ‘.s -0 ’ 

coefficient respectively. ' Impulse (num, den) computes and plots the impulse 
response and grid produces a rectangular grid on the plot. Pr intsys (num, 
den, 's') prints the transfer function at the MATLAB prompt. A hard copy 
can be obtained by selecting, from the screen plot 

File — ► Print 

The step response of a first-order system (Example 3.5, Figure 3.13) is obtained using 
the step command 

File name: examp35.m 

% step response of transfer function G ( s ) =num ( s ) /den ( s ) 

%num and den contain polynomial coefficients 
%in descending power s of s 
c If 

num= [ 1 ] ; 
den=[ 1 1 ] ; 
step (num, den) ; 
grid; 

pr intsys ( num, den, 's' ) ; 
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SIMULINK'. The Control System Toolbox does not possess a ‘ramp’ command, but 
the ramp response of a first-order system (Example 3.6, Figure 3.15) can be obtained 
using SIMULINK, which is an easy to use Graphical User Interface (GUI). SIMU- 
LINK allows a block diagram representation of a control system to be constructed 
and real-time simulations performed. 

With MATLAB Version 5.3, typing simulink at the MATLAB prompt brings 
up the SIMULINK Library Browser. Clicking on the ‘Create new model’ icon in the 
top left-hand corner creates a new window called ‘untitled’. 

Clicking on the El icon attached to SIMULINK lists the SIMULINK options, 
and E Continuous lists the continuous systems options. To obtain a transfer func- 
tion block, click and hold left mouse button on the ‘Transfer Fen’ icon under 
‘Continuous’, and drag to ‘untitled’ window. 

Click on B to close down ‘Continuous’ and click on E ‘Sources’ to drag ‘Ramp’ 
from Browser to ‘untitled’ window. Close down ‘Sources’ and click on E ’Sinks’ to 
drag ‘Scope’ to ‘untitled’. Holding down left mouse button connect ‘Ramp’, ‘Trans- 
fer Fen’ and ‘Scope’ together as shown in Figure Al.l. 

Double click on ‘Scope’ to bring up scope screen, and, in ‘untitled’, click ‘Simula- 
tion’ and ‘Start’. The ramp response should appear on the scope screen. Click on the 
scope screen and choose autoscale (binoculars). Click print icon to obtain a hard 
copy of the ramp response. In the ‘untitled’ window, click on ‘File’ and ‘Save As’ 
and save as a ‘.mdl’ (model) file in a directory of your choice (i.e. examp36.mdl in 
‘work’). 

The transfer function for a second-order system can easily be obtained in terms of 
oj„ and £ using the ord2 command. This has u> n and £ as input arguments and 
generates the numerator and denominator of the equivalent transfer function. The 
script file sec_ord.m shows how Figure 3.19 can be generated using the ord2 and 
step MATLAB commands 

File name: sec_ord.m 

%Second-or der system 

t=[ 0:0.1: 15] ; 

wn=l; 

zeta=0.2; 

[num, den] =ord2 (wn , zeta) ; 

[y , x , t ] =step ( num, den , t ) ; 
zeta = 0.4; 

[numl , deni ] =ord2 (wn , zeta) ; 

[yl , x , t ] =step ( numl , deni , t ) ; 
zeta=0.6 ; 

[num2 , den2 ] =ord2 (wn , zeta) ; 

[y2 , x , t ] =step ( num2 , den2 , t ) ; 
plot (t ,y,t ,yl,t ,y2 ) ; 
grid; 

In sec_ord.m a user supplied common time base (? = 0—1 5 seconds in 0.1 second 
intervals) has been set up. The plot command superimposes the step responses for 
zeta = 0.2, 0.4 and 0.6. 

The step response for Example 3.8, the resistance thermometer and valve, shown in 
Figure 3.23 can be generated with script file examp38.m. 
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Fig. A1.1 SIMULINK model for the ramp response of a first-order system. 


File name: examp38.m 

%Step response of a third-order system 

%G ( s ) =12.5/ ( s+0.5 ) (s A 2+s+25) 

elf 

num=[ 12.5 ] ; 

den=conv( [ 1 0.5 ] , [ 1 1 25 ] ) ; 
step (num, den) ; 
gr id; 

The transfer function is based on equation (3.75), with the input term Xj(s) = 1 /s 
removed. The denominator is input using the conv command (short for convolu- 
tion), which multiplies two polynomial expressions together. 


A1.4 Tutorial 3: Closed-loop control systems 


This tutorial shows how MATLAB can be used to build up and test closed-loop 
control systems. The examples given relate to those solved in Chapter 4. The com- 
mands used in MATLAB to create a single model from the elements in the control 
loop are 


Command Operation 


series 

parallel 

feedback 

cloop 


Combines blocks in cascade, see Transformation 1, Table 4.1 
Combines blocks in parallel, see Transformation 2, Table 4.1 
Eliminates a feedback loop, see Transformation 4, Table 4. 1 
Closes the loop with unity feedback. 


Example 4.5 is a PI controlled liquid-level system shown in Figure 4.26. In the block 
diagram representation, Figure 4.27, the system parameters are 

K\ = 1; 7) = 5 seconds; K v = 0.1m 3 /sV 

Rf = 15 s/m 2 ; A = 2 m 2 ; H\ = 1 


The PI controller and control valve transfer function is therefore 


G c (s) 


0.5s + 0.1 
5s 


and the plant transfer function is 
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Since H\ = 1, the system has unity feedback, and the closed-loop transfer function 
and step response is given by 


Filenam e : examp45. m 

%Example 4.5 (Liquid-Level Process Control System) 

%Use of series and cloop 
numc=[ 0.5 0.1 ] ; 
denc=[ 5 0 ] ; 

nump=[ 15 ] ; 
denp=[ 30 1 ] ; 

[numol ,denol]=series ( numc , dene , nump , denp ) ; 

[numcl , dene l]=c loop ( numol , denol ) ; 
pr intsys (numcl, dencl , 's' ) ; 
step (numcl , dencl) ; 
grid; 

Case study Example 4.6.1 is a CNC machine-tool positional control system, whose 
block diagram representation is shown in Figure 4.31. When system parameter values 
are inserted, the block diagram is as shown in Figure A1.2. 

The closed-loop transfer function and step response is given by 


Filename: examp46Lm 

%Case Study Example 4.6.1 (CNC Machine-Tool Positional Control) 

%Use of series and feedback 

nump=[80] ; 

denp=[ 0.45 0 ] ; 

nump 1=[ 0.365 ] ; 

denpl=[ 1 0 ] ; 

numvf =[ 0.697 ] ; 

denvf=[ 1] ; 

numpf =[ 60] ; 

denpf=[ 1] ; 

[num , den]=f eedback ( nump , denp , numvf , denvf ) ; 

[numfp ,denfp]=series ( num, den , numpl , denpl) ; 

[numcl , dencl ]=f eedback ( numfp , denfp , numpf , denpf ) ; 
pr intsys (numcl, dencl , 's' ) ; 
step ( numcl , dencl ) ; 
grid; 

In this example, the inner loop is solved first using feedback. The controller and 
integrator are cascaded together ( numpl , denpl ) and then series is used to 
find the forward-path transfer function ( numfp , denfp ) . Feedback is then 
used again to obtain the closed-loop transfer function. 

The time response of the CNC control system is also obtained using SIMFIFINK 
as shown in Figure A1.3. Note that the variables t and x 0 have been sent to work- 
space, an area of memory that holds and saves variables. The commands who and 
whos lists the variables in the workspace. The system time response can be obtained 
by the command 

plot (t ,x 0 ) 
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Fig. A1.2 CNC machine-tool positional control system. 
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Fig. A1.3 SIMULINK simulation of CNC machine-tool positional control system. 


Case study Example 4.6.2 is a PID temperature control system, and is represented by 
the block diagram in Figure 4.33. Here, the PID control transfer function is not 
‘proper’, and the series command does not work. The forward path transfer 
function, with values inserted, is 


Gfp(s) 


29.412^ + 39.2165+13.072 
35(4.v+ 1)(8s+ 1) 


The closed-loop transfer function and step response is given by 
Filename: examp462.m 

%Case study example 4.6.2 (Temperature Control) 
%Use of feedback 
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numfp=[ 29.412 39.216 13.072 ]; 
denfp=conv ( [ 3 0 ] , conv ( [ 4 1 ] , [ 8 1 ] ) ) ; 

numt f = [ 1 ] ; 
dentf=[ 1] ; 

[numcl , dencl]=f eedback ( numfp , denfp , numtf , dentf ) ; 
pr intsys (numcl, dencl , 's' ) ; 
step ( numcl , dene 1 ) ; 
grid; 

Case study Example 4.6.3 is a ship autopilot control system. The block diagram 
representation is given by Figure 4.37. Inserting system parameters gives a forward- 
path transfer function 

0.2 

Gfp(s) = 20s^2s 

The closed-loop transfer function and step response is given by 
Filename: examp463.m 

%Case study example 4.6.3 (Ship Autopilot Control System) 

%Use of feedback 
numfp=[ 0.2 ] ; 
denfp=[ 20 2 0 ] ; 

numhf=[ 1] ; 
denhf=[ 1] ; 

[numcl , dencl ]=f eedback ( numfp , denfp , numhf , denhf ) ; 
pr intsys (numcl, dencl , 's' ) ; 
step ( numcl , dene 1 ) ; 
grid; 


A1.5 Tutorial 4: Classical design in the s-plane 


The tutorial demonstrates how MATLAB is used to generate root locus diagrams, 
and hence how to design control systems in the s-plane. Examples given in Chapter 5 
are used to illustrate the MATLAB commands. The roots of the characteristic 
equation (or any polynomial) can be found using the roots command. 


Example 5.1 

Check the stability of the system that has the characteristic equation 

s 4 + 2s 3 + s 2 + 4s + 2 = 0 

At the MATLAB prompt type 

» ce=[ 1 2 1 4 2]; 

» roots ( ce ) 
ans= 

-2.1877 

0. 3516+1. 2843i 
0. 3516-1. 2843i 
-0.5156 


Two roots have positive real parts, hence the system is unstable. 
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Example 5.2 

What values of K\ make the following system unstable 


G(s)H(s) 


s(s 2 + s + 2) 


Filename: examp52.m 

%Roots of denominator of closed-loop transfer function 

kl=0.25 

num= [ 8 * k 1 ] ; 

den=conv ( [ 1 0 ] , [ 1 1 2 ] ) ; 

[ numcl , dencl ] =c loop ( num, den ) ; 
roots ( dencl ) 

Running examp52.m with K\ set to 0.25, 0.15 and 0.35 gives 

» e x amp 5 2 
kl= 

0.2500 


ans= 

0. 0000+1. 4142i 
0. 0000-1. 4142i 
- 1.0000 


» e x amp 5 2 
kl= 

0.1500 


ans= 

-0. 1630+1. 3243i 
-0. 1630-1. 3243i 
-0.6740 

» e x amp 5 2 
kl= 

0.3500 


ans= 

0. 1140+1. 5057i 
0. 1140-1. 5057i 
-1.2280 

Hence, with K\ =0.15, the system is stable, K\ = 0.25, the system has marginal 
stability and K\ = 0.35, the system is unstable. 


Example 5.8 
The root locus for 


G(s)H(s) 


K 

s{s + 2)(s + 5) 


can be drawn using the r locus command as shown in examp58.m 
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Filenam e : ex amp 5 8 . m 

%Example 5.8 Simple root locus 
%G ( s ) =K/s ( s+2 ) ( s+5 ) 
c If 

num= [ 1 ] ; 

den=conv ( conv ( [1 0 ] , [ 1 2 ] ) , [ 1 5]); 
r locus (num, den ) ; 
axis ( [ -9 2 -4 4 ] ) ; 

%axis ( ' squar e ' ) ; 

With no axis command, the axes are generated automatically. Alternatively, user 
defined axes can be generated with axis ( [x min x max y m in Ymaxl )• Using the 
command 'square' generates the same scales on both x and y axes. With 
examp58.m it is easy to experiment with all three methods. 

Using MATLAB to design a system, it is possible to superimpose lines of constant 
( and uj n on the root locus diagram. It is also possible, using a cursor in the graphics 
window, to select a point on the locus, and return values for open-loop gain K and 
closed-loop poles using the command 

[k, poles]=r elocf indfnum, den) 

The script file examp58a.m shows how this is achieved 


Filenam e : ex amp 5 8 a . n i 

%Example 5.8 Root locus 
%G(s)=K/s(s + 2) (s + 5) 
c If 

num= [ 1 ] ; 

den=conv ( conv) [1 0 ] , [ 1 2 ] ) , [ 1 5]); 

r locus (num, den ) ; 

axis ( [ -9 2 -4 4 ] ) ; 

zeta=0.5 ; 

wn=2: 2:8; 

sgr id ( zeta , wn) ; 

[k , poles ] =r locf ind ( num, den) 

Here a line of £ = 0.5 (/3 = 60°) is drawn together with four w n circles (w n = 2, 4, 6 
and 8 rad/s.) At the MATLAB prompt, the user is asked to select a point in the 
graphics window. If the intersection of the complex locus with the ( = 0.5 line is 
selected (see Figure 5.14), the following response is obtained 

» examp58a 

Select a point in the graphics window 

selected point= 

-0. 7143+1. 2541i 
k= 

11.5754 

poles= 

-5.5796 

-0. 7102+1. 2531i 
-0.7102-1.253H 


Example 5.9 is solved using examp59.m to create Figure 5.16. 
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Filename : examp59.m 

%Example 5.9 Root Locus 
%G ( s ) =K/s ( s A 2+4s+13 ) 
c If 

num= [ 1 ] ; 

den=conv ( [ 1 0 ] , [ 1 4 13 ] ) ; 

rlocus (num,den) ; 
axis ( [ -9 2 -4 4 ] ) ; 
zeta=0.25 ; 
wn=3 ; 

sgr id ( zeta , wn) ; 

k=r locf ind ( num, den) %Selectk from graphic window 

When run, the program invites the user to select a point in the graphics window, which 
may be used to find the value of K when ( = 0.25. If the last line of examp59.m is typed 
at the MATLAB prompt, the cursor re-appears, and a further selection can be made, 
in this case to select the value of K for marginal stability. This is demonstrated below 

» e x amp 5 9 

Select a point in the graphics window 
selected_point= 

-0. 7429 + 2. 9175i 
k= 

22.9452 

»k=r locf ind ( num, den ) 

Select a point in the graphics window 
selected_point= 

0+3.6304i 

k= 

52.7222 

» 

Example 5.10 uses the root locus method to design a PD controller that will allow the 
system 

G{s)H{s) = 1 

s{s + 2)(s + 5) 

To meet a given time-domain specification. In examp510.m, the PD controller takes 
the form 

G' c (.v) = K\(s + 2) 


Filename: examp510.m 

%Example 5.10 Root Locus 
%G ( s ) =K ( s+2 ) /s ( s+2 ) ( s+5 ) 
c If 

num= [1 2 ] ; 

den=conv ( conv ([1 0 ] , [ 1 2 ] ) , [ 1 5]); 

rlocus (num, den) ; 

axis ( [ -9 2 -4 4 ] ) ; 

zeta=0.7 ; 

wn=3.5 ; 

sgr id ( zeta , wn) ; 

k=r locf ind (num, den) %Select k from screen 
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num= [ k k * 2 ] ; 

[numcl , dencl] =cloop ( num, den ) ; 

step ( numcl , dencl ) ; 

grid; 

This produces the (pole-zero cancellation) root locus plot shown in Figure 5.18. 
When run, examp510.m allows the user to select the value of K\ that corresponds 
to C= 0.7, and then uses this selected value to plot the step response. The text that 
appears in the command window is 

» examp510 

Select a point in the graphics window 
selected_point= 

-2. 4857+2. 5215i 
k= 

12.6077 

» 


Case study Example 5.11 uses root locus to design a ship roll stabilization system. 
The script file examp5ll.m considers a combined PD and P1D (PIDD) controller of 
the form 


G c (s) 


K\ (s + 2){s 2 + 4s + 8) 
s 


Filename: examp51 1 .m 
%Example 5.11 Root Locus 

%G ( s ) =K ( s+2 ) ( s A 2+4s+8) /s ( s+1) ( s A 2+0.7s+2 ) 
c If 

num=conv( [1 2 ] , [ 1 4 81); 

den=conv ( conv ( [ 1 0 ] , [ 1 1]),[1 0.7 2]); 

r locus (num, den ) ; 

axis ( [ -9 2 -4 4 ] ) ; 

zeta=0.7 ; 

wn=4.2 ; 

sgr id ( zeta , wn) ; 

k=r locf ind (num, den) % Select k from screen 
num=k*conv( [1 2 ] , [ 1 4 8 ] ) ; 

[numcl ,dencl]=cloop ( num, den) ; 

step ( numcl , dene 1 ) ; 

grid; 

This script file produces the root locus shown in Figure 5.24 and allows the user to 
select the value of K furthest from the imaginary axis that corresponds to C, = 0.7. 
The command window text is 

» examp511 

Select a point in the graphics window 
selected_point= 

-3. 2000+3. 2607i 
k- 

10.2416 

» 

When K has been selected, the roll angle step response, as shown in Figure 5.25 is 
plotted. 
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A1.6 Tutorial 5: Classical design in the frequency 
domain 

This tutorial shows how MATLAB can be used to construct all the classical fre- 
quency domain plots, i.e. Bode gain and phase diagrams, Nyquist diagrams and 
Nichols charts. Control system design problems from Chapter 6 are used as examples. 

Example 6.1 

Construct the Bode diagram for 


G(s) 


2 

1+0.55 


Filename: examp6 1 . m 

%Example 6.1 Bode Diagram 
%First-order system 
num= [ 2 ] ; 
den= [0.5 1 ] ; 
bode (num, den) ; 

The Nyquist diagram for the same system is 


Filename: examp61a.m 

%Example 6.1(a) Nyquist Diagram 

%First-order system 

num= [ 2 ] ; 

den= [ 0.5 1 ] ; 

nyquist (num, den) ; 

The script file examp61b.m shows how it is possible to customize a Bode diagram 


Filename: examp61b.m 

%Ex ample 6.1(b) 

%Customizing a Bode Diagram 
c If 

num= [ 2 ] ; 
den= [ 0.5 1 ] ; 

w=logspace (-1,2,200) ; %w f r om 10 A -1 to 10 A 2,200 points 
[mag , phase ,w] =bode (num, den ,w) % cal mag and phase 
semilogx ( w, 20*logl0 (mag) ) ,grid; 
x lab el ( 'Frequency ( r ad/s ) ' ) , y label ( 'Gain dB ' ) ; 

The logspace command allows a vector of frequencies to be specified by the 
user, in this case, 200 points between 10~ ! and 10 2 (rad/s). The bode command has a 
left-hand argument [mag , phase , w] which allows the magnitude and phase to be 
calculated, but not displayed. The semilogx command plots the magnitude (con- 
verted to deciBels) against log frequency, and grid provides a log-linear grid. Script 
file examp62.m produces a second-order Bode gain diagram for Example 6.2. 
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Filename: examp62.m 

%Example 6.2 Bode Diagram 
%Second-or der system 
c If 

num= [ 4 ] ; 

den= [ 0.25 0.2 1 ]; 
w=logspace ( -1 , 2 , 200 ) ; 

[mag , phase ,w] =bode ( num, den ,w) ; 
semilogx(w, 20* loglO(mag)) , gr id ; 

xlabel (' Frequency ( rad/s )'), ylabel ('Gain dB') 

The Nyquist diagram (w varying from — oo to +oo) is produced by examp64.m 
where 

G( ^ ) = ^ + l + 4) 


Filenam e : examp64. m 

%Example 6.4 Nyquist Diagram 
%Third-order type one system 
num= [ 1 ] ; 

den=conv( [1 0 ] , [ 1 2 4 ] ) ; 

nyquist (num, den) ; 

axis ([-0.6 0.1 -0.6 0.1]); 

Note that to obtain a reasonable diagram, it is usually necessary for the user to define the 
scales of the x and y axes using the axis command. The script file examp64a.m produces 
the Bode gain diagrams for the same system when K = 4 and 8, see Figure 6.23(a). 

Filename: examp64a.m 

%Example 6.4(a) 

G ( s ) =K/s ( s A 2+2s+4 ) 

%Creates Bode Gain Diagrams for K=4 and 8 
c If 

num= [ 4 ] ; 

den=conv( [1 0 ] , [ 1 2 4 ] ) ; 
w=logspace (-1,1,200) ; 
mag , phase ,w] =bode ( num, den ,w) ; 
semilogx (w, 20*logl0 (mag) ) ; 
num= [ 8 ] ; 

[magi ,phasel , w] =bode ( num, den , w) ; 

semilogx (w, 20*logl0 (mag) , w , 20*logl0 (magi ) ) ,grid; 
xlabel ( ' Frequency ( rad/s )'), ylabel ( ' Gain ( dB ) ' ) 

Using the command mar gin ( mag, phase ,w) gives 

(a) Bode gain and phase diagrams showing, as a vertical line, the gain and phase 
margins. 

(b) a print-out above the plots of the gain and phase margins, and their respective 
frequencies. 

This is illustrated by running examp64b.m , which confirms the values given in Figure 
6.23, when K = 4. 
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Filename: examp64b.m 

%Ex ample 6.4(b) 

%G ( s ) =K/s ( s A 2+2s+4 ) 

%Creates a Bode Gain and Phase Diagrams for K=4 
%Determines Gain and Phase Margins 
c If 

num= [4] ; 

den=conv ( [ 1 0 ] , [ 1 2 4 ] ) ; 

w=logspace ( -1 , 1 , 200 ) ; 

[mag , phase ,w] =bode (num, den ,w) ; 
mar gin (mag , phase , w) ; 
x lab el ( ' Frequency ( rad/s ) ' ) ; 

Script file fig627.m produces the Nichols chart for Example 6.4 when K = 4, as 
illustrated in Figure 6.27. The command ngrid produces the closed-loop magni- 
tude and phase contours and axis provides user-defined axes. Some versions of 
MATLAB appear to have problems with the nichols command. 

Filename: fig62 7.m 

%Example 6.4 as displayed in Figure 6.27 
%G ( s ) =K/s ( s A 2+2s+4 ) where K=4 
%Nichols Chart 
num= [ 4 ] ; 

den=conv ( [ 1 0 ] , [ 1 2 4 ] ) ; 
nichols (num, den) ; 
ngr id ; 

axis ( [ -210 0 -30 40]); 

Running script file fig629.m will produce the closed-loop frequency response gain 
diagrams shown in Figure 6.29 for Example 6.4 when K = 3.8 and 3.2 (value of K 
for best Hatband response). 

Filename: fig629.m 

%Example 6.4 as displayed in Figure 6.29 
%G ( s ) =K/s ( s A 2+2s+4 ) 

%Creates closed-loop Bode Gain Diagrams for K=3.8 and 3.2 
%Prints in Command Window Mp,k,wp and bandwidth 
c If 

num= [ 3.8 ] ; 

den=conv ( [ 1 0 ] , [ 1 2 4]); 
w=logspace (-1 , 1 , 200) ; 

[ numcl , dencl ] =cloop ( num, den ) ; 

[mag , phase , w] =bode ( numcl , dencl , w) ; 

[Mp , k] =max (20*logl0 (mag) ) 
wp=w(k) 
n=l ; 

while 20*logl0 (mag ( n) ) > =-3 , n=n+l ; end 

bandwidth=w(n) 

num= [3.2] ; 

[ num2cl ,den2cl]=cloop( num, den) ; 

[magi , phase 1 , w] =bode ( num2cl , den2cl , w) ; 
semilogx ( w, 20*logl0 (mag) ,w, 20*logl0 (magi) ) ,grid; 
xlabel( 'Frequency (rad/s) ' ) ,ylabel ( 'Gain)dB) ' ) 
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The command cloop is used to find the closed-loop transfer function. The com- 
mand max is used to find the maximum value of 20 log 10 (mag), i.e. M p and the 
frequency at which it occurs i.e. u p = co(k). A while loop is used to find the —3 dB 
point and hence bandwidth = w ( n) . Thus, in addition to plotting the closed-loop 
frequency response gain diagrams ,fig629.m will print in the command window: 


» 

Mp = 

3.1124 

k= 

121 

wp= 

1.6071 

bandwidth= 

2.1711 


Case study 

Example 6.6 

This is a laser guided missile with dynamics 

GW " (s) = ?^ 5 ) 


The missile is to have a series compensator (design one) of the form 


G(s) 


K(\ +s) 
(1 + 0.25s) 


Figure 6.34 is generated using fig634.m and shows the Nichols Chart for the uncom- 
pensated system. Curve (a) is when the compensator gain K = 1, and curve (b) is 
when K = 0.537 (a gain reduction of 5.4 dB). 


Filename: fig634.m 

%Nichols Chart for Case Study Example 6.6 
%Lead Compensator Design One, Figure 6.34 
c If 

%Uncompensated System 
num= [ 20 ] ; 
den= [1 5 0 0 ] ; 
w=logspace (-1,1,200) ; 

[mag , phase , w] =nichols ( num, den , w) ; 

%Compensator Gain set to unity 
numl= [20 20 ] ; 

denl=conv ( [ 0.25 1 ] , [ 1 5 0 0 ] ) ; 

[magi ,phasel , w] =nichols ( numl , deni , w) ; 
%Compensator Gain reduced by 5.4dB 
num2=[ 10.74 10.74]; 

den2=conv ( [ 0.25 1],[1 5 0 0]); 

[mag2 ,phase2 ,w] =nichols (num2 , den2 ,w) ; 
plot (phase , 20*logl0 (mag) ,phasel , 20*logl0 (magi ) , 
phase 2 , 20* log 10 (mag2 ) ) 
ngr id ; 

axis ( [ -240 -60 -20 30]); 
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A1.7 Tutorial 6: Digital control system design 

This tutorial looks at the application of MATLAB to digital control system design, 
using the problems in Chapter 7 as design examples. 


Example 7.3 

To obtain the z- transform of a first-order sampled data system in cascade with 
a zero-order hold (zoh), as shown in Figure 7.10. 

Filename: examp73.m 

%Example 7.3 Transfer Function to z-Transform 
%Continuous and Discrete Step Response 
num= [ 1 ] ; 
den= [1 1 ] ; 

Ts=0.5 ; 

[ numd , dend] =c2dm ( num, den , Ts , ' zoh ' ) ; 
pr intsys ( num, den , 's' ) 
pr intsys ( numd , dend , ' z ' ) 
subplot ( 12 1 ) , step (num, den) ; 
subplot ( 122 ) , dstep (numd , dend ) ; 

The continuous to discrete command c 2 dm employs a number of conversion meth- 
ods in the last term of the right-hand argument. These include 

' zoh ' zero-order hold 

' f oh ' first-order hold 

' tustin ' tustin’s rule (see equation 7.102) 

The command subplot (mnp ) creates an m-by-n array of equal sized graphs, the 
argument p indicates the current graph. Thus subplot (12;?) produces a single row, 
two column array (i.e. side by side graphs). When p= 1, the left-hand graph is 
produced and when p = 2, the right-hand one is produced. Running examp73.m 
generates step response plots of both continuous and discrete systems, with the 
following text in the command window 

» 

num/den= 

1 

s+1 

num/den= 

0.39347 
z-0. 60653 


Example 7.4 

This is a closed-loop digital control system as shown in Figure 7.14, with a plant 
transfer function 


G p (s) 


1 

5(5 + 2 ) 


Filename: examp74.m 

%Example 7.4 Open and Closed-Loop Pulse Transfer Functions 
%Discrete Step Response 
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num= [ 1 ] ; 

den=conv [1 0 ] , [ 1 2 ] ; 

Ts=0.5 ; 

[numd , dend] =c2dm ( num, den , Ts , ' zoh ' ) ; 

[numcld , dene Id ] =c loop ( numd , dend ) ; 
pr intsys (num, den, 's' ) 
pr int sys ( numd , dend , ' z ' ) 
pr intsys (numcld, dene Id, ' z ' ) 
dstep ( numcld , dencld ) ; 

Note that the command cloop works with both continuous and discrete systems. 
Running examp74.m will produce a step response plot of the closed-loop discrete 
system, and the open and closed-loop pulse transfer functions will be written in the 
command window 


» 

num/ den= 

1 

s A 2+2s 
num/ den= 

0.09197z+0. 06606 
z A 2-1.3679z+0. 36788 
num/ den= 

0.09197z+0. 06606 
z A 2-1.2759z+0. 43394 


%see equation (7.53) 


%see equation (7.55) 


The script file examp75.m simulates the Jury stability test undertaken in Example 7.5. 
With the controller gain K in Example 7.5 (Figure 7.14) set to 9.58 for marginal 
stability see equation (7.75), the roots of the denominator of the closed-loop pulse 
transfer function are calculated, and found to lie on the unit circle in the z-plane. 


Filenam e : ex amp 7 5. m 

%Example 7.5 Stability in the z-plane 

K=9.58 

num= [ K ] ; 

den=conv( [1 0 ] , [ 1 2 ] ) ; 

Ts=0.5 ; 

[numd , dend] =c2dm ( num, den , Ts , 'zoh' ) ; 

[numcld ,dencld]=cloop ( numd , dend ) ; 
pr intsys (numcld, dencld, ' z ' ) 
roots ( dencld) 

Running examp75.m produces command window text 

» 

K= 

9.5800 
num/ den= 

0.88107z+0. 63286 
z A 2-0. 48681 z+ 1.0007 
ans= 

0. 2434+0. 9703i %lies on unit circle i.e. /RP 2 +IP 2 =1 

0. 2434-0. 9703i %see equation (7.87) 
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Example 7.6 constructs the root-locus in the r-plane for the digital control system in 
Example 7.4 (Figure 7.14). 


Filename: examp 76. m 

%Example 7.6 Root Locus Analysis in the z-plane 
num= [ 1 ] ; 

den=conv ([1 0 ] , [ 1 2]); 

Ts=0.5 ; 

[ numd , dend] =c2dm ( num, den , Ts , ' zoh ' ) ; 
r locus ( numd , dend ) ; 
axis ( ' square ' ) 
zgr id ; 

k=r locf ind ( numd , dend ) 

Note that r locus and r locf ind works for both continuous and discrete sys- 
tems. The statement ' squar e ' provides square axes and so provides a round unit 
circle. The command zgr id creates a unit circle together with contours of constant 
natural frequency and damping, within the unit circle. When examp76.m has been 
run, using r locf ind at the MATLAB prompt allows points on the loci to be 
selected and values of K identified (see Figure 7.20) 

»Select a point in the graphics window 
selected_point= 

0. 2212+0. 9591i 
k— 

9.7078 

»k=r locf ind ( numd , dend ) 

Select a point in the graphics window 
selected_point= 

-2. 0876-0. 0117i 

k= 

60.2004 

k = r locf ind ( numd , dend ) 

Select a point in the graphics window 
selected_point= 

- 1.0092-0. 0117i 
k= 

103.3290 
Example 7 .7 

A laser guided missile has dynamics 


and a compensator 


G(s)H(s) 


20 

s 2 (s + 5) 


G e (s) 


0 . 8(1 + 5 ) 

(1 + 0.0625 s) 


Script file examp77.m plots the closed-loop step responses of both the continuous 
system and discrete system (see Figure 7.21). In the latter case the plant pulse transfer 
function uses zoh, and the compensator is converted into discrete form using 
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Tustm s rule. Subplot (211) and (212) creates a 2 row, single column plot matrix (i.e. 
produces 2 plots, one beneath the other). 


Filenam e : ex amp 77 .m 

%Example 7.7 Digital Compensator using Tustin's Rule 
%Laser Guided Missile 
num= [ 20 ] ; 

den=conv( [1 0 0 ] , [ 1 5 ] ) ; 

Ts=0.1; 

ncomp=0.8* [1 1 ] ; 
dcomp= [ 0.0625 1] ; 

[nol,dol]=series( ncomp , dcomp , num, den) ; 

[ncl , del ] =cloop ( nol , dol ) ; 

[numd , dend] =c2dm ( num, den , Ts , ' zoh ' ) ; 

[ncomd , dcomd] =c2dm ( ncomp , dcomp , Ts , ' tust in ' ) ; 
pr intsys (num, den, 's' ) 
pr int sys ( numd , dend , ' z ' ) 
pr intsys ( ncomp , dcomp , ' s ' ) 
pr int sys ( ncomd , dcomd , ' z ' ) 

[nold,dold]=series( ncomd , dcomd , numd , dend ) ; 

[ncld , dcld] =cloop ( nold , dold ) ; 
subplot (211) , step (ncl, del) ; 
subplot ( 2 12 ) , dst ep (nc Id , dcld ) ; 

The open continuous transfer functions and pulse transfer functions for the plant and 
compensator are printed in the command window 


» 

num/ den= 

20 

s A 3+5s A 2 
num/ den= 

0.0029551z A 2+0.010482z+0.002 302 
z a 3-2.6065z a 2+2.2131z-0.6065 3 
num/ den= 

0.8s+0.8 
0.0625s+l 
num/ den= 

7.4667z-6.7556 

z-0.11111 


%see equation (7.108) 


%see equation (7.110) 


Example 7.8 

Here pole placement is used to design a digital compensator that produces exactly the 
step response of the continuous system. 

Filenam e : ex amp 7 8. m 

%Example 7 . 8 Digital Compensator Design using Pole Placement 

K=0.336 

numk=K* [ 3 ] ; 

num= [ 3 ] ; 
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den=conv ([1 0 ] , [ 1 1]); 

Ts=0.5 ; 

[ ncl , del] =cloop ( numk , den) ; 
ncomd=0.327* [ 1-0.6065 ] ; 
dcomd= [ 1-0.519 ] ; 

[ numd , dend] =c2dm ( num, den,Ts, 'zoh' ) ; 

[nold,dold]=series (ncomd , dcomd , numd , dend) ; 

[ ncld , dcld] =cloop ( nold , dold ) ; 
pr intsys ( num, den , 's' ) 
pr intsys ( numd , dend , ' z ' ) 
pr intsys ( ncomd , dcomd , ' z ' ) 
pr intsys (ncl, del, 's' ) 
pr intsys (ncld, dcld, ' z ' ) 
subplot ( 2 11 ) , step (ncl , del) ; 
subplot ( 2 12 ) , dstep (ncld, dcld) ; 

The continuous and discrete closed-loop systems are shown in Figures 7.22(a) and 
(b). The digital compensator is given in equation (7.128). Script fde examp78.m 
produces the step response of both systems (Figure 7.25) and prints the open and 
closed-loop continuous and pulse transfer functions in the command window 

» 

K= 

0.3360 
num/den= 

3 

s a 2+s 
num/den= 

0.31959z+0. 27061 
z A 2-1.6065z+0. 60653 
num/den= 

0.327z-0. 19833 
z-0.519 
num/den= 

1.008 

s A 2+s+1.008 
num/den= 

0.10451z A 2+0.025 107z-0.053669 
z A 3-2. 02 1 z A 2+l. 4654 z- 0.36846 


%see equation (7.115) 

%see equation (7.128) 


A1.8 Tutorial 7: State-space methods for control system 
design 

This tutorial looks at how MATLAB commands are used to convert transfer func- 
tions into state-space vector matrix representation, and back again. The discrete-time 
response of a multivariable system is undertaken. Also the controllability and obser- 
vability of multivariable systems is considered, together with pole placement design 
techniques for both controllers and observers. The problems in Chapter 8 are used as 
design examples. 
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Example 8.4 

This converts a transfer function into its state-space representation using 
tf2ss(num, den) and back again using ss2tf (A, B , C , D , iu) when iu 
is the ith input u, normally 1. 

Filenam e : ex amp 8 4.m 

%Example 8.4 transfer function to state space representation 

%And back again 

num= [ 4 ] ; 

den= [1 3 6 2]; 

pr intsys (num, den, 's' ) 

[ A , B , C , D] =tf 2ss ( num, den ) 

[numl ,denl]=ss2tf(A,B,C,D,l) ; 
pr intsys ( numl , deni , 's' ) 
condition_number=cond (A) 

The print-out in the command window is 

» examp84 
num/den= . 

4 

s A 3+3s A 2+6s+2 

A= 

-3 -6 -2 

10 0 
0 10 
B = 

1 

0 

0 

c= 

0 0 4 

D= 

0 

num/ den= 

4.441e-016s A 2+5.329e-015s+4 

s A 3+3s A 2+6s+2 

condit ion_number= 

24.9599 

Comparing the output with equation (8.35) it will be noticed that the top and bottom 
rows of A have been swapped, which means that the state variables x\ and have 
also been exchanged. This means that if the user is expecting the state variables to 
represent particular parameters (say position, velocity and acceleration), then the 
rows of A and B, and the columns of C might have to be re-arranged. 

The conversion from state-space to transfer function has produced some small 
erroneous numerator terms, which can be neglected. These errors relate to the 
condition of A, and will increase as the condition number increases. 

Example 8.8 uses c2d to calculate the discrete-time state and control transition 
matrices A(T) and B(T) as given by equations (8.78), (8.80), (8.82) and (8.85). The 
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matrix-vector difference equation (8.76) is then used to calculate the first five discrete 
values of the state variables when responding to a unit step input. 


Filename: examp88.m 

%Calculate state and control transition matrices 
A= [ 0 1 ; -2 -3] 

3— [ 0 ; 1] 

Ts=0.1 

[AT ,BT]=c2d(A,B,Ts) 

%Compute discrete step response 

kT=0 

x= [ 0 ; 0 ] 

U— 1 

for i— 1: 5 

xnew=AT*x+BT*u ; %Matr ix-vector difference equation (8.76) 

kT=kT+Ts 

x=xnew 

end 

The command window text is 

» e x amp 8 8 
A= 

0 1 

-2 -3 

B = 

0 

1 

Ts= 

0.1000 

AT= 

0.9909 0.0861 
-0.1722 0.7326 


BT= 

0.0045 

0.0861 

kT= 

0 

x= 

0 

0 

u= 

1 

kT= 

0.1000 

x= 

0.0045 

0.0861 

kT= 

0.2000 


0.0164 

0.1484 
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kT= 

0.3000 

x= 

0.0336 

0.1920 

kT= 

0.4000 

x= 

0.0543 

0.2210 

kT= 

0.5000 

x= 

0.0774 

0.2387 


The for-end loop in examp88.m that employs equation (8.76), while appearing very 
simple, is in fact very powerful since it can be used to simulate the time response of any 
size of multivariable system to any number and manner of inputs. If A and B are time- 
varying, then A (T) and B(r) should be calculated each time around the loop. The 
author has used this technique to simulate the time response of a 14 state-variable, 6 
input time- varying system. Example 8.10 shows the ease in which the controllability and 
observability matrices M and N can be calculated using c t r b and ob s v and their rank 
checked. 


Filenam e : examp8 10. m 
%Example 8 . 10 

%Contr ollability and observability 
A= [ - 2 0 ; 3 - 5 ] 

B=[l; 0] 

C=[l -1] 

D= [0] 

M=ctrb (A,B ) 
r ank_o f _M= r ank ( M ) 
system_order=length (A) 

N= ( obsv ( A, C ) ) ' 

Rank_of_N=r ank (N ) 


The command window will display 

» examp810 
A= 

-2 0 
3 -5 
B= 

1 

0 

C= 

1 -1 
D= 

0 
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0 3 

r ank_of_M= 

2 

system_or der= 

2 %rank of M = system or der . System completely 

%contr ollable . 

N= 

1 -5 

-1 5 

r ank_of_N= 

1 %rank of N< system order . System is unobservable . 

Example 8.11 uses Ackermann’s formula ( acker ) to calculate the elements of a 
regulator feedback matrix K, that places the closed-loop poles at some desired 
location in the s-plane. 

Filename: examp8 ll.m 
%Ex ample 8.11 

%Regulator design using pole placement 
%G ( s ) =l/s ( s+4 ) 
num= 1 ; 

den=conv ([1 0 ] , [ 1 4]); 
pr intsys ( num, den , 's' ) 

%convert to state space 
[ A, B , C , D] =tf 2ss ( num, den ) ; 

%Check for controllability; 
r ank_of_M=r ank ( ctrb ( A , B ) ) 
system_or der=length (A) 

%Enter desired characteristic equation 
char eqn= [1 4 4 ] 

%Calculate desired closed-loop poles 
desire dp ole s=roots( char eqn) 

%Calculate feedback gain matrix using Ackermann's formula 
K=acker (A,B,desiredpoles) 

%Closed-loop state feedback system 
Asf =A-B*K ; Bsf =B ; Csf=C; Dsf =0 ; 

[ numsf ,densf]=ss2tf (Asf,Bsf,Csf,Dsf) ; 
densf 

roots ( densf ) 

In examp811.m, the closed-loop transfer function is obtained and the roots of the 
denominator calculated to check that the closed-loop poles are at the desired loca- 
tions. The output at the command window is 

» e x amp 811 
num/den= 

1 

s a 2+4s 

r ank_of_M= 

2 

system_or der {=} 

2 


% Rank of M = system order hence system 
% is controllable 
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char eqn= 

14 4 

desire dp ole s= 

-2 

-2 

K= 

0 4 
densf = 

14 4 
ans= 

-2 

-2 % Actual closed-loop poles = desired closed-loop poles 

Example 8.12 shows how acker uses the transpose of the A and C matrices to 
design a full-order state observer. 

Filename: examp812.m 

%Example 8 . 12 

%Full-order observer design using pole placement 
A= [0 1 ; -2 -3 ] 

B= [0 ; 1] 

C=[l 0] 

D= [0] 

%Check for observability; 

N=obsv ( A, C ) 
rank_or_N=r ank (N ) 
system_order=length (A) 

%Enter desired characteristic equation 
chareqn=[l 10 100] 

%Calculate desired observer eigenvalues 
desir ed_eigenvalues=roots ( char eqn) 

%Calculate observer gain matr ix using Ackermann ' s formula 
Ke=acker (A' , C ' , desir ed_eigenvalues ) 

The command window text is 

» examp812 
A= 

0 1 
-2 -2 
B = 

0 

1 
C = 

1 0 
D= 

0 

N= 

1 0 
0 1 

r ank_of_N= 

2 

system_order= 

2 


% Rank of N = system order hence system 
% is observable 
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char eqn= 

1 10 100 

desir ed_eigenvalues= 

-5. 0000+8. 6603i 
-5. 0000-8. 6603i 
Ke= 

7.0000 77.0000 % Agrees with equation (8.150) 

Example 8.13 illustrates the design of a regulator combined with a reduced-order 
state observer. 


Filename: examp813.m 
%Ex ample 8.13 

%Regulator and reduced-order observer design 

%Using pole placement 

%G(s)=l/s(s+2)(s+5) 

% Input in state-space format directly 
A= [ 0 1 0 ; 0 0 1 ; 0 -10 -7] 

B=[0; 0; 1] 

C=[l 0 0] 

D= [0] 

%Regulator design 

%Check for controllability; 

r ank_of_M=r ank ( ctrb ( A , B ) ) 

%Enter desired characteristic equation 
chareqn=[l 7 25 15] 

%Calculate desired closed-loop poles 
desir edpoles=r oots ( char eqn) ; 

%Calculate feedback gain matrix using Ackermann's formula 
K=acker (A,B,desiredpoles) 

%Reduced-order observer design 
A1E= [ 10] 

AEE= [ 0 1 ; —10 -7] % See equation (8.163) 
obchareqn=[l 63.2 2039.4] 
ob serve rp ole s=roots( ob char eqn) ; 

%Calculate observer matrix using Ackermann ' s formula 
Ke=acker ( AEE ' , A1E ' , observerpoles ) 

Note that the transposes of the partitioned matrices Ai e and A ee from equation 
(8.163) are used in acker to calculate K e for the reduced-order state observer. 
The command window output is 

» e x amp 813 
A= 

0 10 
0 0 1 

0 -10 -7 
B = 

0 
0 

1 
c= 

1 

D= 

0 


0 


0 
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char eqn= 

1 7 25 15 

K= 

15.0000 15.0000 0 % Regulator feedback matrix 

A1E= 

1 0 
AEE = 

0 1 
-10 -7 
obchar eqn= 

1.0e+003* 

0.0010 0.0632 2.0394 
Ke= 

1.0e+003* 

0.0562 1.6360 %Reduced-or der observer matrix 


A1.9 Tutorial 8: Optimal and robust control system 
design 

This tutorial uses the MATLAB Control System Toolbox for linear quadratic 
regulator, linear quadratic estimator (Kalman filter) and linear quadratic Gaussian 
control system design. The tutorial also employs the Robust Control Toolbox for 
multivariable robust control system design. Problems in Chapter 9 are used as design 
examples. 

Example 9.1 

This example uses the MATLAB command lqr to provide the continuous solution 
of the reduced matrix Riccati equation (9.25) 


Filename: examp91.m 
%Example 9 . 1 

%Continuous Optimal Linear Quadratic Regulator (LQR) Design 
A= [ 0 1 ; -1 -2] 

B=[0; 1] 

Q= 1 2 0 ; 0 1] 

R= [ 1] 

[ K , P , E ] =lqr ( A , B , Q , R ) 

The output at the command window is 

» examp91 
A= 

0 1 

-1 -2 

B — 

0 

1 
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Q= 

2 0 
0 1 
R= 

1 

K= 

0.7321 0.5425 


P= 

2.4037 0.7321 
0.7321 0.5425 
E = 

-1. 2712+0. 3406i 
-1. 2712-0. 3406i 


%State weighting matrix, see equation (9.8) 

%Control weight ing matr ix , see equation (9.8) 

%State Feedback gain matrix, see equations 
% ( 9 . 20 ) and (9.46) 

%Riccati matrix, see equation (9.45) 
%Closed-loop eigenvalues 


Example 9.2 

This example solves the discrete Riccati equation using a reverse-time recursive 
process, commencing with P(«) = 0. Also tackled is the discrete state-tracking 
problem which solves an additional set of reverse-time state tracking equations 
(9.49) to generate a command vector v. 


Filename: examp92.m 

%Ex ample 9 . 2 

%Discrete Solution of Riccati Equation 
%Optimal Tracking Control Problem 
A=[ 0 1; -1 -1 ] ; 

B= [ 0 ; 1] ; 

Q= 1 10 0 ; 0 1]; 

R= [ 1 ] ; 

F=[ 0.9859 -0.27; 0.08808 0.76677]; 

G=[ -0.9952 0.01409; -0.04598 -0.08808]; 

S= [ 0 ; 0 ] ; %Initialize 

T=0 ; 

V=0 ; 

Ts=0.1 ; 

[AD ,BD]=c2d(A,B,Ts) ; 

P= [ 0 0 ; 0 0 ] ; 

H=BD'*P; 

X=Ts*R+H*BD; 

Y=H*AD ; 

K=X\Y ; 

%Discrete reverse-time solution of the Riccati equations (9.29) 
%and (9.30) 

%Discrete reverse-time solution of the state tracking equations 
% ( 9 . 53 ) and (9.54) 
for i=l : 200 
L=Ts*Q+K'*Ts*R*K ; 

M=AD-BD*K ; 

PP1=L+M'*P*M ; %Value of Riccati matrix at time (N-(k+l) )T 

RIN=[-sin(0.6284*T) ; 0.6* cos ( 0.6284*T ) ] ; 

SP1=F*S+G*RIN ; 

V=— B'*SP1; %Value of command vector at time (N-(k+l))T 

S=SP1 ; 
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T=T+Ts ; 

P=PP 1 ; 
H=BD'*P; 
X=Ts*R+H*BD ; 
Y=H*AD ; 
K=X\Y; 

end 


%Value of feedback gain matrix at time 
% (N- (k+1) ) T 


Checking values in the command window gives 


» examp92 
» A 
A= 

0 1 
-1 -1 
» B 
B = 

0 

1 

»Q 

Q= 

10 0 
0 1 
» R 
R= 

1 

» Ts 
Ts= 

0.1000 
» AD 
AD= 

0.9952 0.0950 
-0.0950 0.9002 
»BD 
BD= 

0.0048 
0.0950 
» K 
K= 

2.0658 1.4880 

»P 

P= 

8.0518 2.3145 
2.3145 1.6310 


%State weighting matrix 

%Control weighting matrix 

%Discr ete-time state transition matrix 

%Discr ete-time control transition matrix 

%Discrete-time steady-state feedback gain 
% matrix, after 200 reverse-time iterations 

%Steady-state value of Riccati matrix 


The reverse-time process is shown in Figure 9.3. The discrete-time steady-state feed- 
back matrix could also have been found using lqrd, but this would not have 
generated the command vector v. The forward-time tracking process is shown in 
Figure 9.4 using K(kT) and v(kT) to generate Uoptf^T) in equation (9.55). The script 
file kalfilc.m uses the MATLAB command lqe to solve the continuous linear 
quadratic estimator, or Kalman filter problem. 
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Filename: kalfilc.m 

%Continuous Linear Quadratic Estimator (Kalman Filter) 

A= [ 0 1 ; -1 -2] 

B= [ 0 ; 1] 

C= [ 1 0 ; 0 1 ] 

D=[0] 

R= [ 0.01 0 ; 0 1] 

Cd= [ 0.1 0 ; 0 0.01] 

Q= [ 0.1 0 ; 0 0.1] 

[ K , P , E ] =lqe (A,Cd,C,Q,R) 


The command window text is 

»kalf ilc 
A= 

0 1 
-1 -2 
B= 

0 

1 

C= 

1 0 
0 1 
D= 

0 

R= 


0.0100 

0 

%Measurement noise covariance matrix 

0 

1.0000 


Cd= 

0.1000 

0 

%Disturbance matrix 

0 

0.0100 


Q= 

0.1000 

0 

%Disturbance noise covariance matrix 

0 

0.1000 


K= 

0.1136 

-0.0004 

%Kalman gain matrix 

-0.0435 

0.0002 

P= 

0.0011 

-0.0004 

%Estimation error covariance matrix 

-0.0004 

0.0002 


F.= 

-1. 0569+0. 2589i 

%Closed-loop estimator eigenvalues 

-1.0569- 

0.2589i 



The script file kalfild.m solves, in forward-time, the discrete solution of the Kalman 
filter equations, using equations (9.74), (9.75) and (9.76) in a recursive process. The 
MATLAB command Iqed gives the same result. 


Filename: kalfild.m 

%Discrete Linear Quadratic Estimator (Kalman Filter) 

%The algorithm uses discrete transition matrices A(T) and Cd(T) 
A= [ 0 1 ; — 2 -3] 
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Cd= [ 0.1 0 ; 0 0.1] 

C= [ 1 0 ; 0 1 ] 

ID=eye (2 ) ; 

Ts=0.1 

[AT ,CD]=c2d(A,Cd,Ts) 

R= [ 0.01 0 ; 0 1.0] 

Q=[0.1 0 ; 0 0.1] 

%Discrete solution of Kalman filter equations 
%Init ialize 

P1=ID; %Initial covariance matrix=identity matrix 

P2= (AT*P1*AT ' )+(CD*Q*CD' ) ; 

X=P2*C ' ; 

Y= ( C *P2 *C ' )+R; 

K=X/Y ; 

P3= ( ID- ( K*C ) ) *P2 ; 

%Solve recursive equations 
for i— 1: 20 
P1=P3 ; 

P2= (AT*P1*AT ' ) + ( CD*Q*CD ' ) ; 

X=P2*C ' ; 

Y= ( C *P2 *C ' )+R; 

K=X/Y ; 

P3= ( ID- ( K*C ) ) *P2 ; 
end 


Checking results in the command window 


» kalf ild 


A= 

0 1 
-2 -3 
Cd= 

0.1000 

0 

%Disturbance matrix 

0 

0.1000 


C= 

1 0 

0 1 
Ts= 

0.1000 

AT= 

0.9909 

0.0861 

%Discr ete-time state transition matrix 

-0.1722 

0.7326 


CD= 

0.0100 

0.0005 

%Discr ete-time disturbance transition 

-0.0009 

0.0086 

%matr ix 

R= 

0.0100 

0 

%Measurement noise covariance matrix 

0 

1.0000 


Q= 

0.1000 

0 

%Disturbance noise covariance matrix 

0 

0.1000 


» K 

K= 

0.0260 

-0.0002 

%Kalman gain matrix after 21 iterations 

-0.0181 

0.0002 
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Case study 

Example 9.3 

This is a china clay band drying oven. The state and output variables are burner 
temperature, dryer temperature and clay moisture content. The control parameters 
are burner gas supply valve angle and clay feed-rate. A linear quadratic Gaussian 
control strategy is to be implemented. Script file examp93.m calculates the optimal 
feedback control matrix K and also the Kalman gain matrix K e using the recursive 
equation (9.99). 


Filename: examp93.m 

%Linear Quadratic Gaussian (LQG) Design 
%Case Study Example 9.3 Clay Drying Oven 
%Optimal Controller 

A= [-0.02128 0 0 ; 0.0006 -0.005 0;0 -0.00038 -0.00227] 
B= [8.93617 ; 0 ; 0] 

Cd=[0.1 0 0 ; 0 0.1 0 ; 0 0 0.00132] 

C= [ 1 0 0 ; 0 1 0 ; 0 0 1 ] 

D= [ 0 ] 

Ts=2 ; 

[AT, BT] =c2d ( A , B , Ts) 

Q= [ 0 0 0 ; 0 0.5 0;0 0 20] 

R=[l] 

[ K , P , E ] =lqr (A,B ,Q,R) 

%Kalman Filter 

Re= [ 0.01 0 0;0 0.01 0;0 0 7.46] 

Qe= [ 0.1 0 0 ; 0 0.1 0 ; 0 0 0.1] 

[AT ,CD]=c2d(A,Cd,Ts) 

%Initialize 

%Implement equations (9.99) 

ID=eye ( 3 ) ; 

P1=ID; %Initial covariance matrix=identity matrix 
P2= ( AT*P1*AT ' )+(CD*Qe*CD' ) ; 

X=P2*C ' ; 

Y=(C*P2*C') +Re ; 

Ke=X/Y ; 

P3= ( ID- ( Ke*C ) ) *P2 ; 

%Solve recursive equations 
for i— 1: 19 
P 1=P3 ; 

P2=(AT*Pl*AT') + (CD*Qe*CD' ) ; 

X=P2*C ' ; 

Y= ( C*P2*C ' ) +Re ; 

Ke=X/Y ; 

P3= ( ID- ( Ke*C ) ) *P2 ; 

End 

Ke 

P3 

The output at the command window is 

» e x amp 9 3 
A= 
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-0.0213 

0 

0 



0.0006 

-0.0050 

0 


B = 

0 

-0.0004 

-0.0023 



8.9362 





0 





0 




Cd= 

0.1000 

0 

0 



0 

0.1000 

0 

%Disturbance matrix, equation 


0 

0 

0.0013 


C= 

10 0 

0 10 

0 0 1 




D= 

0 




AT= 

0.9583 

0 

0 



0.0012 

0.9900 

0 

%A(T) , Ts=2 seconds 


0.0000 

-0.0008 

0.9955 


BT= 

17.4974 

0.0105 

0.0000 



%B(T), equation (9.86) 

Q= 

0 

0 

0 



0 

0.5000 

0 

%State weighting matrix 


0 

0 

20.0000 


R= 

1 



%Control weighting matrix 

K= 

0.0072 

0.6442 

-1.8265 

%Feedback gain matrix, 
%equation (9.92) 

P= 






1.0e+003* 




0.0000 

0.0001 

-0.0002 



0.0001 

0.0108 

-0.0300 

%Riccati matrix , equation 


-0.0002 

-0.0300 

3.6704 

% ( 9.91 ) 

E = 






-0. 0449+0. 0422i 


%Closed-loop eigenvalues, 





%equation (9.93) 


-0.0449- 

-0.0033 

0.0422i 



Re= 

0.0100 

0 

0 



0 

0.0100 

0 

%Measurement noise covariance 


0 

0 

7.4600 

%matrix, equation (9.100) 

Qe= 

0.1000 

0 

0 



0 

0.1000 

0 

%Disturbance noise covariance 


0 

0 

0.1000 

%matrix, equation ( 9.101 ) 

CD= 

0.1958 

0 

0 

%Discr ete-time disturbance 


0.0001 

0.1990 

0 

%transition matrix, equation 
% ( 9.95 ) 
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0.0000 

-0.0001 

0.0026 


0.4408 

0.0003 

0.0000 

%Kalman gain matrix after 20 
%iter ations , 

0.0003 

0.4579 

0.0000 

%equation (9.102) 

0.0000 

-0.0006 

0.0325 

% and Figure 9.16 

0.0044 

0.0000 

0.0000 

%Estimation error covariance 
%matr ix , 

0.0000 

0.0046 

0.0000 

%after 20 iterations. 

0.0000 

0.0000 

0.2426 

%equation (9.102) 


The implementation of the LQG design is shown in Figures 9.12 through to 9.17. 
Example 9.6 

This is a multivariable robust control problem that calculates the optimal 
controller. The MATLAB command hinf opt undertakes a number of iterations 
by varying a parameter 7 until a best solution, within a given tolerance, is achieved. 

Filename: examp96.m 
%Ex ample 9 . 6 

%Multivar iable robust control using H infinity 
%Singular value loop shaping using the weighted mixed 
%sensitivity approach 
nug= 200 ; 

dng= [ 1 3 102 200]; 

[ ag, bg, eg , dg] =tf 2 ss ( nug, dng) ; 

ss_g=mksys ( ag ,bg , eg, dg) ; 

w 1 — [ 1 100 ; 100 1 ]; 

nwlneg = [ 100 1 ] ; 

dwlneg = [ 1 100 ] ; 

w 2 = [ 1 ; 1 ] ; 

w3= [ 100 1 ; 1 100]; 
nw3neg= [ 1 100 ] ; 
dw3neg= [ 100 1 ] ; 

[TSS_1] =augtf ( ss_g, wl , w2 , w3 ) ; 

[ ap , bp , cp , dp ] =br anch ( TSS_) ; 

[ gamopt , ss_f , ss_cl ] =hinf opt (TSS_, 1) ; 

[ acp ,bcp , ccp , dep ] =b ranch ( ss_f ) ; 

[acl, bcl , ccl , del] =b ranch ( ss_cl ) ; 

[ numcp ,dencp]=ss 2 tf ( acp , bep , ccp , dep , 1 ) ; 
pr intsys ( nug, dng , 's' ) 
pr intsys ( nwlneg , dwlneg , 's') 
pr intsys ( nw3neg , dw3neg , ‘s' ) 
w=logspace ( -3 , 3 , 200 ) ; 

% [mag, phase , w] =bode ( nwlneg , dwlneg , w) ; 

% [magi , phase 1 , w] =bode ( nw3neg , dw3neg , w) ; 

%semilogx (w, 20 *logl 0 (mag) ,w, 20 *logl 0 (magi ) ) , gr id ; 

[ sv , w] =sigma ( ss_g) ; 

% [ sv , w] =sigma ( ss_cl ) ; 

% [ sv ,w] =sigma ( ss_f ) ; 
semilogx (w, 20 *logl 0 ( sv) ) ,grid; 
ag 
bg 
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eg 

dg 

acp 

bep 

cep 

dep 

pr int sys ( numcp , dencp , 's' ) 


The command mksys packs the plant state-space matrices ag, bg, eg and dg into a 
tree structure ss_g. 

The command augtf augments the plant with the weighting functions as shown 
in Figure 9.31. The branch command recovers the matrices ap, bp, cp and dp 
packed in TSS_. The hinf opt command produces the following output in the 
command window 


No 

Gamma 

D11<=1 

P-Exist 

V 

II 

0 

S-Exist 

s>0 

1 am ( P S ) < 1 

C.L. 

1 

1.0000e+000 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

2 

5.0000e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

3 

2.5000e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

4 

1.2500e-001 

OK 

OK 

OK 

OK 

OK 

OK 

STAB 

5 

1.8750e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

6 

1.5625e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

7 

1.4063e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

8 

1.3281e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

9 

1.2891e-001 

OK 

OK 

OK 

OK 

OK 

OK 

STAB 

10 

1.3086e-001 

OK 

OK 

FAIL 

OK 

OK 

OK 

UNST 

11 

1.2988e-001 

OK 

OK 

OK 

OK 

OK 

OK 

STAB 


Iteration no. 11 is your best answer under the tolerance: 0.0100. 


After eleven iterations, hinf opt identifies that 7 in equation (9.176) has a best 
value of 0.13. The command sigma calculates the data for a singular value Bode 
diagram as shown in Figures 9.32, 9.34 and 9.35. Other information printed in the 
command window is given below 


num/ den= 

200 

s a 3+3s a 2+102s+200 
num/ den= 

100s+l 

s+100 

num/ den= 
s+100 
lOOs+l 
ag= 

-3 -102 -200 
10 0 
0 10 


%Plant transfer function 


%Wi 1 ( s ) 
%W t 1 ( s ) 
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bg= 

l 

0 

0 

cg= 

0 0 200 

dg= 

o 

acp= 


-0.0100 

-0.0022 

0.0039 

0.0148 

0.1367 

%Contr oiler 
%matr ices , 

-0.0086 

-7.7634 

21.6533 

37.1636 

621.8932 

%See equation 
% ( 9 . 178 ) 

-0.0461 

-2.0317 

-3.1477 

-2.2338 

-81.8751 


0.4353 

0.1067 

8.8071 

-102.2531 

-37.7767 


, 0.6756 

bcp= 

-7.9756 

0.0906 

0.5820 

-8.8009 

-13.6595 

ccp= 

0.1970 

13.5575 

-3.7282 

-162.5129 


-0.0861 

dcp= 

0 

num/den= 

0.1698 

0.1213 

-0.6544 

-11.1708 



159. 1184 s A 4+16389. 1905 s A 3+63965. 5785 s A 2+1654830. 8855s+3182367. 0874 
s a 5+2 75.687 s A 4+20439.8141s A 3+324835.0198s A 2+3782679.1393s+3 7794.3283 


%Controller transfer function, 
%See equation (9.179) 


A1.10 Tutorial 9: Intelligent control system design 

This tutorial uses the MATLAB Control System Toolbox, the Fuzzy Logic Toolbox 
and the Neural Network Toolbox. Problems in Chapter 1 0 are used as design examples. 

Example 10.3 

This is the inverted pendulum control problem and, as a benchmark, is initially 
solved as a multivariable control problem, using pole placement (Ackermann’s 
formula) to calculate the feedback gain matrix in exampl03.m. 

Filename: examp 103m 

%Regulator design using pole placement 
%Inverted pendulum problem 

A= [ 0 1 0 0 ; 9.81 0 0 0;0 0 0 l;-3.27 0 0 0] 

B= [ 0 ; -0.667; 0; 0.889] 

C=[l 0 0 0] 

D=0 

%Check for controllability; 
r ank_of_M=r ank ( ctrb ( A , B ) ) 
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%Enter desired characteristic equation 
chareqn=[l 12 72 192 256] 

%Calculate desired closed-loop poles 
desire dp ole s=roots( chareqn) 

%Calculate feedback gain matrix using Ackermann's formula 
K=acker (A,B,desiredpoles) 

The output at the command window is 

» examp 103 

0 1.0000 0 0 

9.8100 0 0 0 

0 0 0 1.0000 

-3.2700 0 0 0 

B- 

0 

-0.6670 

0 

0.8890 

C= 

1 0 0 0 

D= 

0 

r ank_of_M= 

4 

char eqn= 

1 12 72 192 256 
desir edpoles= 

-4. 0000+4. OOOOi 
-4. 0000-4. OOOOi 
-2. 0000+2. OOOOi 
-2. 0000-2. OOOOi 
K= 

-174.8258 -57.1201 -39.1437 -29.3578 

The state-variable feedback solution was implemented in SIMULINK as shown in 
Figure A 1.4. 

Inverted Pendulum, Fuzzy Logic Controller Design: The fuzzy logic controller used 
for the inverted pendulum problem has four input windows and one output window 
as shown in Figure 10.14. One version of the controller has a Mamdani-type rulebase 
consisting of 11 rules as given in equation (10.52). The MATLAB Fuzzy Inference 
System (FIS) Editor can be entered by typing at the MATLAB prompt 

» fuzzy 

This brings up the main menu screen as shown in Figure A 1.5. Double-clicking on 
the ‘theta’ icon brings up the membership function editor. Figure A1.6 shows the NB 
fuzzy set being given the trapizoidal (trapmf) membership function [—1—1 —0.10]. 
Other membership functions include gaussmf (Gaussian), trimf (triangular) and 
gbellmf (generalized bell). For further information type 

» help fuzzy 

Returning to the main menu and double-clicking on the centre box entitled 
‘Pendulum IF (mamdani) will bring up the FIS rule editor, as shown in Figure 
A1.7. Highlighted are the antecedents and the consequent of Rule 1. 
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theta 



Fig. A1.4 Inverted pendulum control system design using pole placement 



And method 

Or method 

Implication 

Aggregation 

min ▼ 


Current Variable 


max ▼ 

Name 


min ▼ 

max ▼ 

Type 

Range 






Fuzzification 

centroid ▼ 


Help 


Close 








System "Pendulum'll": 4 inputs, 1 output, and 11 rules 


Fig. A1.5 Main menu of Fuzzy Inference System (FIS) editor. 


FIS Variables 


theta f 



xdot 



Input variable “theta” 


Current Variable 

Name 

Type 

Range 

Display Range 


theta 

input 


[- 0.1 0 . 1 ] 


[- 0.1 0 . 1 ] 


Current Membership Function (click on MF to select) 
Name 


NB 


Type 

Params 


trapmf 


[-1 -1 - 0.1 0 ] 




Help 


Close 





Ready 


Fig. A1.6 FIS membership function editor. 
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1 . If (theta is PB) and (tdot is PB) then (f is PB) (1 ) 


2. If (theta 

3. If (theta 

4. If (theta 

5. If (theta 

6. If (theta 

7. If (theta 

8. If (theta 

9. If (theta 

10. If (tdot 

1 1 . If (tdot 


is PB) and (tdot is Z) then (f is PB) (1) 
is PB) and (tdot is NB) then (f is Z) (1) 
is Z) and (tdot is PB) then (f is PB) (1) 
is Z) and (tdot is Z) then (f is Z) (1) 
is Z) and (tdot is NB) then (f is NB) (1) 
is NB) and (tdot is PB) then (f is Z) (1) 
is NB) and (tdot is Z) then (f is NB) (1) 
is NB) and (tdot is NB) then (f is NB) (1) 
is PB) then (f is PB) (1) 
is NB) then (f is NB) (1) 


If 


and 


and 


and 


Then 


theta is 

|~NB 

[Z 


PB 


none 


not 


tdot is 

|~nI 

|z 


PB 


none 


not 


x is 
NB 

Z 

PB 


none 


not 


xdot is 


f is 

NB 


NB 

Z 

Z 

PB 

PB 

none 

none 




not I I not 


-Connection - 
O or 
® and 


Weight 


1 


Delete rule | 

| Add rule | 

| Change rule | 


□ □ 


FIS Name: Penduluml 1 


Help 


Close 


Fig. A1.7 FIS rule editor. 



Fig. A1.8 Simulink implementation of inverted pendulum fuzzy logic control problem. 
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When editing is complete, the controller is stored as a fis file, in this case 
pendulum 1 1 .f is. The inverted pendulum fuzzy logic control problem can now be 
implemented in SIMULINK as shown in Figure A1.8. The fuzzy logic icon is 
obtained by opening the fuzzy logic toolbox within the Simulink Library Browser, 
and dragging it across. Running the simulation as it stands in Figure A1.8 will bring 
up a MATLAB error because the properties of the fuzzy logic controller have not 
been defined. At the MATLAB prompt, type 

» f ismat=r eadf is 

This will allow you to select from a directory a suitable stored filename, i.e. 
pendulum 11. fis. The system will respond with 

f ismat= 

name: 'Pendulumll' 

type: 'mamdani' 

andMethod: 'min' 

orMethod: 'max' 

def uzzMethod : 'centroid' 
impMethod: 'min' 

aggMethod: 'max' 

input: [1x4 struct] 

output: [lxl struct] 

rule: [lxll struct] 

This means that the fuzzy logic controller parameters have been placed in the work- 
space under ' f ismat ' , and that the simulation can now proceed. More details on 
the properties of the fuzzy logic controller can be found by typing 

» out=getf is ( f ismat ) 

The system will respond with 

Name = Pendulumll 
Type = mamdani 
Numlnputs=4 
InLabels= 
theta 
tdot 
x 

xdot 

NumOutputs=l 

OutLabels= 


f 

NumRules =11 

AndMethod =min 

OrMethod =max 

ImpMethod =min 

AggMethod =max 


DefuzzMethod =centroid 
Out= 

Pendulum 11 

The results of the pole placement and the 1 1 rule and 22 rule fuzzy logic controllers 
are compared in Figure 10.15. Figure 10.16 shows the 9—6 control surface, also 
generated using the FIS Editor. 
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hidden layer 

tansig activation function 


Fig. A1.9 Demonstration neural network. 


The MATLAB Neural Network Toolbox: This Toolbox was not used in the Exam- 
ples given in Chapter 10. For details on the Toolbox, type 

» help nnet 

To demonstrate how the Toolbox is used, consider a neural network with a structure 
shown in Figure A1.9. 

The script file neural l.m trains and runs the network. 

Filename: neural l.m 

%Feedforward Back-propagation Neural Network 
%Network structure: l:10(tansig):l (pur el in) 

%P=Input values 
P= [012345678]; 

%T=Target values 

T= [ 0 0.84 0.91 0.14 -0.77 -0.96 -0.28 0.66 0.99]; 
plot (P ,T, ' o ' ) ; 

%Use Levenber g-Marquar dt back-propagation training 

net=newf f ( [ 0 8 ] , [ 10 1 ],{' tansig '' pur elin trainlm' ) ; 

Yl=sim ( net , P ) ; 

plot (P,T,P,Y1, 'o' ) ; 

net.trainParam.epochs=50 ; 

net=tr ain ( net , P , T ) ; 

Y2=sim ( net , P ) ; 
plot(P,T,P,Y2, 'o' ) ; 

P is a vector of inputs and T a vector of target (desired) values. The command 
newff creates the feed-forward network, defines the activation functions and the 
training method. The default is Fevenberg-Marquardt back-propagation training 
since it is fast, but it does require a lot of memory. The train command trains the 
network, and in this case, the network is trained for 50 epochs. The results before and 
after training are plotted. 


Appendix 2 
Matrix algebra 


A2.1 Definitions 

Matrix : An m x n matrix A is an array of elements with m rows and n columns, and 
is written as 


A = 


(t 11 

a 12 

■ • @\n 

U2\ 

Ct22 

Clin 


a m2 

■ • &mn 


If m = n, A is a square matrix. 
Vector: A column vector x is 


(A2.1) 


A row vector y is 


Xl 

X2 

X m 


y = [j'i J2 • • • y n ] 


Null matrix : This has all elements equal to zero. 


B 


0 0 
0 0 

0 0 


(A2.2) 


(A2.3) 


(A2.4) 


Diagonal matrix : This is a square matrix with all elements off the diagonal equal to 


C = 


c n 

0 

0 


0 

0 

<°33 


zero. 


0 

C22 

0 


(A2.5) 
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Identity matrix : This is a diagonal matrix with all diagonal elements equal to unity, 
and is normally denoted by I. 


1 = 


1 

0 

0 


0 0 
1 0 
0 1 


Symmetric matrix : This is a square matrix where elements ay = ap. 


5 


S= 8 


9 


8 9 
4 2 
2 3 


(A2.6) 


(A2.7) 


A2.2 Matrix operations 

Transpose of a matrix : The transpose of a matrix A, denoted by A T , is formed by 
interchanging its rows and columns. 


A = 


2 

3 

6 


4 5 
1 9 
8 4 


A t 


2 3 6 

4 1 8 

5 9 4 


(A2.8) 


(A2.9) 


Determinant of a matrix: Given a 2 x 2 matrix 


Its determinant is 



a 11 

a 12 

«21 

022 


det A = 


an 

ai\ 


a 12 
«22 


a 1 1 #22 — # 21^12 


(A2.10) 


(A2.ll) 


Minors of an Element: The minor My of element ay of det A is the determinant 
formed by removing the z'th row and the /th column from det A. 


det A = 


8 6 
4 3 
9 5 


2 

1 

7 


M23 — 


8 

9 


6 

5 


— 14 


(A2.12) 


Cofactor of an Element: The cofactor Cy of element ay of det A is defined as 


C g = (-1 f +J) My 
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In general, the determinant of a square matrix is given by 

n 

det A = ciikCik (expanding along the /th row) 
k—\ 


or 

m 

det A = ^ cikjCkj (expanding along the /th column) 
k—\ 


Given 


A = 


2 4 
1 3 

6 8 


5 

0 

9 


Expanding along the first column gives 

3 0 


det A = 2 


- 1 


8 9 
= 2(27)- 1 (-4) 
= -32 


5 
9 

6 ( — 1 5 ) 


(A2.13) 


(A2.14) 


Singular matrix : A matrix is singular if its determinant is zero. 
Nonsingular matrix : A matrix is nonsingular if its determinant is not zero. 


Adjoint of a matrix'. The adjoint of an n x n matrix is the transpose of the matrix 
when all elements have been replaced by their cofactors. 


adj A = 


c 11 

C12 . . 

.. C 1 „ 

C21 

C22 ■ ■ 

.. C 2 „ 

c„ 1 

C n 2 .. 

■ • C n n 


(A2.15) 


Inverse of a matrix : An n x n matrix A has an inverse A , which satisfies the 
relationship 

A~'A = AA~‘ = I (A2.16) 


The inverse of A is given by 

A -i = adj A 
det A 


Addition and subtraction of matrices: The sum of two matrices 


(A2.17) 


A + B = C 


is given by 


O ij T bjj — Cij 


the difference between two matrices 


(A2.18) 


A — B = C 
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is given by 


Q-ij by — Cjj 


Multiplication of matrices : The product of two matrices 

AB = C 


(A2.19) 


is given by 


Multiplication by a constant 


— ^ ' aubki 


A = 


kA = 


k=\ 


Oil 

012 

021 

022 _ 

kan 

kan 

kci 2 l 

ka 2 2 


Note that in general, multiplication is not commutative, i.e. AB f BA. 


(A2.20) 


(A2.21) 


Trace of a matrix : The trace of an n x n matrix is the sum of the diagonal elements of 
the matrix. 


tr A — a 1 1 + CI 22 + • • • + a m 


(A2.22) 


Rank of a matrix : The rank of a matrix is equal to the number of linearly independ- 
ent rows or columns. The rank can be found by determining the largest square 
submatrix that is nonsingular. 


If 


A = 


1 2 

0 4 

1 2 


3 

1 

3 


since det A is zero, the 3x3 matrix is singular. Consider a submatrix 


A S ub 


1 2 

0 4 


(A2.23) 


(A2.24) 


The determinant of A su b is 4, hence the rank of A is the size of A su b, i.e. 2. 



References and further 
reading 


Ackermann, J. (1972) Der Entwurf Linearer Regelungssysteme im Zustandsraum, Regelung- 
stechnik und Prozessdatenverarbeitung, 7, pp. 297-300. 

Anderson, J.A. (1972) A Simple Neural Network Generating an Interactive Memory, Math- 
ematical Biosciences , 14 , pp. 197-220. 

Anderson, B.D.O. and Moore, J.B. (1979) Optimal Filtering, Prentice-Hall, Englewood Cliffs, NJ. 

Anderson, B.D.O. and Moore, J.B. (1990) Optimal Control, Prentice-Hall, Englewood Cliffs, 

^ NJ. 

Astrom, K.J. and Wittenmark, B. (1984) Computer Controlled Systems, Prentice-Hall, Inc., 
Englewood Cliffs, NJ. 

Astrom, K.J. and Wittenmark, B. (1989) Adaptive Control, Addison- Wesley, Reading, Mass. 

Athans, M. (1971) The Role and Use of the Stochastic Linear-Quadratic-Gaussian Problem in 
Control System Design, IEEE Trans, on Automatic Control AC-16, 6, pp. 529-551. 

Atherton, D.P. (1982) Nonlinear Control Engineering, Van Nostrand Reinhold, London. 

Bellman, R. (1957) Dynamic Programming, Princeton University Press, Princeton, NJ. 

Bennett, S. (1984) Nicholas Minorsky and the automatic steering of ships, IEEE Control 
Systems Magazine, 4 , pp. 10-15. 

Bode, H.W. (1945) Network Analysis and Feedback Amplifier Design, Van Nostrand, Prince- 
ton, NJ. 

Brown, M. and Harris, C. (1994) Neurofuzzy Adaptive Modelling and Control, Prentice-Hall 
International (UK) Hemel Hempstead, UK. 

Burns, R.S. (1984) The Automatic Control of Large Ships in Confined Waters, PhD Thesis, 
University of Plymouth (then Plymouth Polytechnic). 

Burns, R.S. (1989) Application of the Riccati Equation in the Control and Guidance of Marine 
Vehicles. In: The Riccati Equation in Control, Systems, and Signals, Pitagora Editrice, 
Bologna, Italy, pp. 18-23. 

Burns, R.S. (1990) The Design, Development and Implementation of an Optimal Guidance 
System for Ships in Confined Waters, Proc: Ninth Ship Control Systems Symposium, Naval 
Sea Systems Command, Department of the Navy, Bethesda, USA, 9-14 September, 3, 
pp. 386-401. 

Burns, R.S. (1991) A Multivariable Mathematical Model for Simulating the Total Motion of 
Surface Ships. In: Proc. European Simulation Multiconference, The Society for Computer 
Simulation International, Copenhagen, Denmark, 17-19 June. 

Burns, R.S. (1995) The Use of Artificial Networks for the Intelligent Optimal Control of 
Surface Ships, IEEE Journal of Oceanic Engineering, 20(1); Special Issue: Advanced Control 
& Signal Processing for Oceanic Applications, 20(1), pp. 66-72. 

Burns, R.S. (1997) The Application of Artificial Intelligence Techniques to Modelling and 
Control of Surface Ships. In: Proc. 11th Ship Control Systems Symposium, Southampton 
UK, April, 1, 77-83. 



References and further reading 429 


Burns, R.S. (1997) Intelligent Manufacturing, Journal of Aircraft Engineering and Aerospace 
Technology, MCB University Press, 69(5), pp. 44CU446. 

Burns, R.S. and Richter, R. (1995) A Neural Network Approach to the Control of Surface 
Ships, Journal of Control Engineering Practice, International Federation of Automatic 
Control, Elsevier Science, 4(3), pp. 411-416. 

Burns, R.S., Richter, R. and Polkinghorne, M.N. (1995) A Multivariable Neural Network Ship 
Mathematical Model. In: Marine Technology and Transportation, Graczyk, T., Jastrzebski, 
T., Brebbia, C.A. and Burns R.S. (eds.), Southampton U.K., Computational Mechanics. 

Burns, R.S., Sutton, R. and Craven, P.J. (2000) A Multivariable Online Intelligent Autopilot 
Design Study. In: The Ocean Engineering Handbook, El-Hawary, F. (ed.), CRC Press, Boca 
Raton, Florida, pp. 252-259. 

Cadzow, J.A. and Martens, H.R. (1970) Discrete-Time and Computer Control Systems, 
Prentice-Hall, Inc., Englewood Cliffs, N.J. 

Chiang, R.Y. (1988) Modern Robust Control Theory, PhD Dissertation, USC. 

Chiang, R.Y. and Safonov, M.G. (1992) Robust Control Toolbox for Use with MATLAB. 
Users Guide , MathWorks. 

Chu, C.C. (1985) Hoo-Optimization and Robust Multivariable Control, PhD Thesis, Univer- 
sity of Minnesota, Minneapolis, MN. 

Craven, P.J. (1999) Intelligent Control Strategies for an Autonomous Underwater Vehicle, PhD 
Thesis, Department of Mechanical and Marine Engineering, University of Plymouth, UK. 

Craven, P.J., Sutton, R. and Burns, R.S. (1997) Intelligent Course Changing Control of an 
Autonomous Underwater Vehicle. In: Twelfth International Conference on Systems Engin- 
eering, Coventry, UK, September, 1, pp. 159-164. 

Dernuth, H. and Beale, M. (1993) Neural Network Toolbox for Use with MATLAB - User’s 
Guide, The MathWorks, Inc., Natick, Mass. 

Dorato, P. (ed.) (1987) Robust Control, IEEE Press, New York. 

Dorf, R.C. (1992) Modern Control Systems, 6th ed., Addison-Wesley, Reading, Mass. 

Dove, M.J.. Burns, R.S. and Evison, J.L. (1986) The use of Kalman Filters in Navigation 
Systems - Current Status and Future Possibilities. In: Proc. of the Int. Conf. on Computer 
Aided Design, Manf. and Operation in the Marine and Offshore Industries, Keramidas, G.A. 
and Murthy, T.K.S. (eds.), Springer- Verlag, Washington, DC, pp. 361-374. 

Drew, B.L. and Burns, R.S. (1992) Simulation of Optimal Control and Filtering of an 
Industrial China Clay Dryer. In: European Simulation Symposium on Simulation and AI in 
Computer Aided Techniques, The Society for Computer Simulation, Dresden, 5-8 Novem- 
ber, pp. 531-535. 

Dreyfus, S.E. (1962) Variational Problems with Inequality Constraints, J. Math. Anal. Appl, 
4, p. 297. 

Dutton, K., Thompson, S. and Barraclough, B. (1997) The Art of Control Engineering , 
Addison-Wesley-Longman, Harlow, Essex. 

Evans, W.R. (1948) Graphical Analysis of Control Systems, Transactions of the AIEE, 
67, pp. 547-551. 

Francis, B.A. (1987) A Course in Hoo Control Theory, Springer-Verlag, New York. 

Franklin, G.F., Powell, J.D. and Workman, M.L. (1990) Digital Control of Dynamic Systems , 
2nd ed., Addison-Wesley, Menlow Park, CA. 

Goldberg, D.E. (1983) Computer-aided gas pipeline operation using genetic algorithms and 
rule learning (Doctoral dissertation. University of Michigan). Dissertation Abstracts Inter- 
national, 44(10), p. 3174B (University Microfilms No. 8402282). 

Goldberg, D.E. (1989) Genetic Algorithms in Search, Optimization & Machine Learning, 
Addison-Wesley Publishing Company, Inc., Reading, Mass. 

Grace, A., Lamb, A.J., Little, J.N. and Thompson, C.M. (1992) Control System Toolbox for 
Use with MATLAB - User’s Guide, The MathWorks, Inc., Natick, Mass. 



430 Advanced Control Engineering 


Grimble, M.J., Patton, R.J. and Wise, D.A. (1979) The design of dynamic ship positioning 
control systems using extended Kalman filtering techniques, IEEE Conference, Oceans ’79, 
CA, San Diego. 

Grimble, M.J. and Johnson, M.A. (1988) Optimal Control and Stochastic Estimation: Theory 
and Application, Vois 1 and 2, John Wiley & Sons, Chichester, UK. 

Healey, M. (1967) Principles of Automatic Control , The English Universities Press, 
London. 

Hebb, D.O. (1949) The Organization of Behaviour, Wiley, New York. 

Holland, J.H. (1975) Adaption in natural and artificial systems. The University of Michigan 
Press, Ann Arbor. 

Hughs, T.P. (1971) Elmer Sperry: Inventor and Engineer, Johns Hopkins Press, Baltimore, 
pp. 232-233. 

James, H.M., Nichols, N.B. and Phillips, R.S. (1947) Theory of Servomechanisms, McGraw- 
Hill, New York. 

Jang, J.S.R. (1993) ANFIS: Adaptive Network-based Fuzzy Inference System, IEEE Transac- 
tions on Systems, Man and Cybernetics, 23, pp. 665-685. 

Johnson, J. and Picton, P. (1995) Designing Intelligent Machines, Vol. 2, Concepts in Artificial 
Intelligence, Butterworth-Heineman (in association with The Open University), Oxford, UK. 

Jury, E.I. (1958) Sampled-Data Control Systems , John Wiley & Sons, New York. 

Kalman, R.E. (1961) On the General Theory of Control Systems. In: Proceedings of the First 
International Congress IF AC, Moscow 1960: Automatic and Remote Control, Butterworth & 
Co., London, pp. 481-492. 

Kalman, R.E. and Bucy, R.S. (1961) New Results in Linear Filtering and Prediction Theory, 
J. of Basic Eng., Trans, of the Am. Soc. of Mech. Eng., pp. 95-108. 

Kohonen, T. (1988) Self-Organization and Associative Memory, Springer-Verlag, Berlin. 

Kuo, B.C. (1980) Digital Control Systems, Holt, Rinehart and Winston, Inc., New York. 

Kurzweil, R. (1990) The Age of Intelligent Machines, M.l.T. Press, Cambridge, Mass. 

Laub, A.J. (1979) A Schur Method for Solving Riccati Equations, IEEE Trans, on Automat. 
Contr., AC-24, pp. 913-921. 

Lehtomaki, N.A., Sandell, Jr., N.R. and Athans, M. (1981) Robustness Results in Linear- 
Quadratic Gaussian Based Multivariable Control Designs, IEEE Trans, on Automat. Contr., 
AC-26(1), pp. 75-92. 

Leigh, J.R. (1985) Applied Digital Control, Prentice-Hall International, Englewood Cliffs, NJ. 

Luenberger, D.G. (1964) Observing the State of a Linear System, IEEE Trans. Military 
Electronics, MIL-8, pp. 74-80. 

Lyapunov, A.M. (1907) Probleme general de la stabilite du mouvement. In: Ann. Fac. Sci., 
Toulouse, 9, pp. 203-474 (Translation of the original paper published in 1893 in Comm. Soc. 
Math. Kharkow). 

MacFarlane, A.G.J. and Kouvaritakis, B. (1977) A design technique for linear multivariable 
feedback systems. International Journal of Control, 25, pp. 837-874. 

Mamdani, E.H. (1976) Advances in linguistic synthesis of fuzzy controllers, Int. J. Man & 
Mach. Studies, 8(6), pp. 669-678. 

Maxwell, J.C. (1868) On Governors. In: Proceedings of the Royal Society of London, 16. 

Mayr, O. (1970) The Origins of Feedback Control, M.l.T. Press, Cambridge, Mass. 

McCulloch, W.S. and Pitts, W.H. (1943) A logical calculus of ideas immanent in nervous 
activity. Bulletin of Mathematical Biophysics, 5, pp. 115-133. 

Merritt, H.E. (1967) Hydraulic Control Systems, John Wiley and Sons, New York. 

Minorski, N. (1922) Directional stability of automatically steered bodies, J. American Society 
of Nava! Engineers, 34, pp. 280-309. 

Minorski, N. (1941) Note on the angular motion of ships. Trans. American Society of Mech. 
Eng., 63, pp. 111-120. 



References and further reading 431 


Morari, M. and Zafiriou, E. (1989) Robust Process Control, Prentice-Hall, Inc., Englewood 
Cliffs, NJ. 

Moscinski, J. and Ogonowski, Z. (eds.) (1995) Advanced Control with MATLAB and SIMU- 
LINK, Ellis Horwood, Hemel Hempstead, UK. 

Nyquist, H. (1932) Regeneration Theory, Bell System Technical Journal, 11 , pp. 126-147. 

Ogata, K. (1995) Discrete-Time Control Systems, 2nd ed., Prentice-Hall, Inc., Upper Saddle 
River, NJ. 

Ogata, K. (1997) Modern Control Engineering , 3nd ed., Prentice-Hall, Inc., Upper Saddle River, NJ. 

Payne, H.J. and Silverman, L.M. (1973) On the Discrete Time Algebraic Riccati Equation, 
IEEE Trans. Automatic Control, AC-18, pp. 226-234. 

Pearson, A.R., Sutton, R., Burns, R.S. and Robinson, P. (2000) A Kalman Filter Approach to 
Fault Tolerance Control in Autonomous Underwater Vehicles. In: Proc. 14th International 
Conference on Systems Engineering, Coventry, 12-14 September, 2, pp. 458-463. 

Phillips, C.L. and Harbor, R.D. (2000) Feedback Control Systems, 4th ed., Prentice-Hall, Inc., 
Upper Saddle River, NJ. 

Polkinghorne, M.N. (1994) A Self-Organising Fuzzy Logic Autopilot for Small Vessels, PhD 
Thesis, School of Manufacturing, Materials and Mechanical Engineering, University of 
Plymouth, UK. 

Polkinghorne, M.N., Roberts, G.N. and Burns, R.S. (1994) The Implementation of a Fuzzy 
Logic Marine Autopilot. In: Proc. IEE Control 94, Warwick, UK, March 2, pp. 1572-1577. 

Pontryagin, L.S., Boltyanskii, V.G., Gamkrelidze, R.V. and Mishchenko, E.F. (1962) The 
Mathematical Theory of Optimal Processes, John Wiley & Sons, New York. 

Postlethwaite, I., Edward J.M. and MacFarlane, A.G.J. (1981) Principal gains and principal 
phases in the analysis of linear mulltivariable feedback systems, IEEE Transactions on 
Automatic Control, AC-26, pp. 32-46. 

Raven, F. (1990) Automatic Control Engineering, 2nd ed., McGraw-Hill, New York. 

Rechenburg, I. (1965) Cybernetic solution path of an experimental problem. Royal Aircraft 
Establishment Translation No. 1122, B.F. Toms (trans.), Farnborough, Hants, Ministry of 
Aviation, Royal Aircraft Establishment. 

Rezevski, G. (ed.) (1995) Designing Intelligent Machines, Vol. 1 , Perception, Cognition and 
Execution, Butterworth-Heineman (in association with The Open University), Oxford, UK. 

Riccati, J.F. (1724) Animadversiones In Aequationes Differentiales, Acta Eruditorum Lipsiae. 
Re-printed by Bittanti, S. (ed.) (1989) Count Riccati and the Early Days of the Riccati 
Equation , Pitagora Editrice, Bologna, Milano. 

Richter, R. (2000) A Predictive Fuzzy-Neural Autopilot for the Guidance of Small Motorised 
Marine Craft, PhD Thesis, Department of Mechanical and Marine Engineering, University 
of Plymouth, UK. 

Richter, R., Burns, R.S., Polkinghorne, M.N. and Nurse, P. (1997) A Predictive Ship Control 
using a Fuzzy-Neural Autopilot. In: Eleventh Ship Control Systems Symposium, South- 
ampton, UK, 14-18 April, 1, pp. 161-172. 

Rosenblatt, F. (1961) Principles of Neurodynamics: Perceptrons and the Theory of Brain 
Mechanisms, Spartan Press, Washington, DC. 

Rosenbrock, H.H. (1974) Computer Aided Control System Design, Academic Press, New York. 

Routh, E.J. (1905) Dynamics of a System of Rigid Bodies, Macmillan & Co., London. 

Rumelhart, D.E., Hinton, G.E. and Williams, R.J. (1986) Learning internal representations by 
error propagation. In: Parallel Distributed Processing, Rumelhart, D.E. and McClelland, 
J.L. (eds.), M.I.T. Press, Cambridge, Mass. 

Safanov, M.G. (1980) Stability and Robustness of Multivariable Feedback Systems, M.I.T. 
Press, Cambridge, Mass. 

Schwarzenbach, J. and Gill, K.F. (1979) System Modelling and Control, Edward Arnold, 
London. 



432 Advanced Control Engineering 


Shannon, C.E. and Weaver, W. (1949) The mathematical theory of communication , University 
of Illinois Press, Urbana. 

Smith, O.J.M. (1957) Closer Control of Loops with Dead Time, Chem. Eng. Progress, 53(5), 
pp. 217-219. 

Sperry, E.A. (1922) Automatic Steering. Trans. Soc. Naval Arch. & Marine Eng., XXX, 
pp. 53-57. 

Sugeno, M. (ed.) (1985) Industrial Applications of Fuzzy Control, Elsevier Science Publishers 
BV, North-Holland. 

Sutton, R. and Jess, I.M. (1991) A Design Study of a Self-Organising Fuzzy Autopilot for Ship 
Control. In: IMechE, Proc. Instn. Mech. Engrs., 205, pp. 35 — 47. 

Sutton, R. and Marsden, G.D. (1997) A Fuzzy Autopilot Optimized using a Genetic Algo- 
rithm, Journal of Navigation, 50(1), pp. 120-131. 

Sutton, R., Burns, R.S. and Craven, P.J. (2000) Intelligent Steering Control of an Autonomous 
Underwater Vehicle, Journal of Navigation, 53(3), pp. 51 1-525. 

The MathWorks Inc. (1993) SIMULINK Numerical Simulation Software - Reference Guide, 
The MathWorks Inc., Natick, Mass. 

Tong, R.M. (1978) Synthesis of fuzzy models for industrial processes, Int. J. Genera I Systems, 
4, pp. 143-162. 

Van Dyke Parunak, H. (1990) Focus on Intelligent Control, Inter. J. of Integrated Manufac- 
turing, pp. 1-5. 

Werbos, P. (1974) Beyond Regression: New Tools for Prediction and Analysis in the Behav- 
ioural Sciences, Thesis in Applied Mathematics, Harvard University. 

Widrow, B. (1987) The Original Adaptive Neural Net Broom-Balancer. In: Proc. IEEE Int. 
Symp. Circuits and Systems, pp. 351-357. 

Widrow, B. and Hoff, M.E. (1960) Adaptive switching circuits. In: IEEE WESCON Conven- 
tion Record, IRE, New York, pp. 96-104. 

Widrow, B. and Smith, F.W. (1964) Pattern recognising control systems. In: Computer and 
Information Sciences, Ton, J.T. and Wilcox, R.H. (eds.), Spartan Books, Cleaver Hume 
Press, pp. 288-317. 

Wiener, N. (1949) The Extrapolation, Interpolation and Smoothing of Stationary Time Series, 
John Wiley, New York. 

Yan, J., Ryan, M. and Power, J. (1994) Using fuzzy logic - Towards intelligent systems, 
Prentice-Hall International (UK), Hernel Hempstead, UK. 

Zadeh, L.A. (1965) Fuzzy Sets. In: Information and Control, 8. pp. 338-353. 

Zames, G. (1966) On the Input-Output Stability of Time-Varying Non-Linear Feed- 
back Systems. Parts I and II. IEEE Trans, on Automat. Contr., AC-11(2 & 3), pp. 228- 
238, 465 — 476. 

Zames, G. (1981) Feedback and Optimal Sensitivity: Model Reference Transformations, 
Multiplicative Seminorms and Approximate Inverses, IEEE Trans, on Automat. Contr., 
AC-26, pp. 301-320. 

Ziegler, J.G. and Nichols, N.B. (1942) Optimum Settings for Automatic Controllers, trans. 
ASME, 64, pp. 759-768. 



Index 


A/D converter 198 
Acceleration 14, 17 
Acceleration due to gravity 29 
Acceleration error coefficient 169 
Accelerator pedal 13 
Acceptable transient response in the 
s-plane 122 
Accumulator! s) 198 
Acker 405 

Ackermann’s formula 251, 253, 257, 259, 
263, 299, 340 
Activation function 348 
Activation functions 
hard-limiting 349 
hyperbolic tangent 349 
linear 349 
sigmoid 349 
Active: 

lead compensation 179 
lead compensation element 1 96 
phase lag compensator 189 
Actual: 

heading 9, 101 
rudder angle 9 
temperature 7 
value 10 
Actuating: 
device 10 
element 10 
force 8 

Actuation subsystem 326 
Actuator saturation 91 
Adaptive linear element (ADLINE) 347 
Adaptive network based fuzzy inference 
system (ANFIS) 362 

Adaptive search and genetic algorithms 326 

Addition and subtraction of matrices 426 

Additive uncertainty 303 

Address bus 199 

Adjoint matrix 242 

Adjoint of a matrix 426 

Aerodynamic drag 13 


Aerodynamic forces 8 
Ailerons 7 
Air gap flux 72 
Aircraft elevator control 7 
Airliner 12 
Aliasing 200 
Amplitude ratio 145 
Amplitudes of vibration 193 
Analogue: 
circuits 10 
control signal 9 
signal 10 
Anderson 347 
Angle criterion 123 
Angle of departure 131,142 
Angles of departure and arrival 126 
Angular: 

displacement 33, 61 
position 19 

positional control system 106 
velocity 19, 60 
Antecedent 330 

Antecedent-consequent linguistic rules 332 
Anti-aliasing filter 200 
Applied torque 19 
Approximate linear relationship 28 
Argand Diagram 148 
Argument 149-150 
Arithmetic logic unit (ALU) 198 
Armature: 
constant 73 
control 71 

controlled dc servo-motor 75 
current 72 
excitation voltage 73 
inductance 73 
resistance 73 
winding 73 

Artificial intelligence (AI) 3, 325 
Artificial neural networks (ANNs) 3, 347 
ASCII 382 
Assembler 198 



434 Index 


Asymptote angles 127, 131, 137 
Asymptote intersection 126, 127, 131, 
137 

Asymptote intersection (break 
frequency) 159 

Asymptote intersection: first-order 
system 154 

Asymptote intersection: second-order 
system 155 
Asymptotes 142 
Asymptotic approximation: Bode 
diagrams 1 53 

Asymptotic construction: Bode plot 1 54 
Athans 3 

Augmented plant matrix PCs) 3 1 5 
Augtf 416 
Author 299 

Autonomous systems 325 
Autopilot 273 
Autoscale 384 
Auxiliary polynomial 1 1 7 
Average magnitude of sensitivity 
function 305 
Axis 390 
Axon 347 


Back emf 73 

Back-propagation 356, 362 
Back-propagation algorithm (BP A) 347, 
351, 377 

Band drying oven 289 
Bandwidth 175-179, 183, 186, 188-189, 
191-192, 194-197, 200, 222 
Bandwidth (cub) 172 
Bang-bang control 7, 273 
Barrett 373 

Bell Telephone Laboratories 2 
Bellman 3, 272 

Best estimate of measured variable 285 
Best flatband response 175-178 
Bias 348 

Bilinear transformation 222 
Bill of materials 4 
Binary word 198 
Biological neurons 347 
Black box approach 358 
Block diagram 4 
form 63 
manipulation 67 
reduction 66 


transformation theorems 67, 68 
with interaction 68 
Blocks in cascade 207 
Bode 2 
Bode 393 

Bode diagram 151-152,165, 
first-order system 154,159 
lead compensator 185 
pure integrator 158 
second-order system 157,160 
active lead network 180 
Boltzmann constant 373 
Boolean AND function 333 
Boolean OR function 333 
Bound of multiplicative uncertainty 306 
Bound of the multiplicative model 
uncertainty 311,323 
Boundary of a system 4 
Bounded inputs 304 
Branch 416 

Breakaway points 121, 126, 127, 138, 142, 
218-20, 230 
Break-frequency 200 
Breeding of successive generations 365 
Bucy 3, 285 
Bulk modulus 77 
Burner 6 

exhaust temperature t/,(t) 289 

gas supply valve angle v a (t) 289 
model 290 
Burns 290, 299, 359 


C and C++ 199 
C2d 402 
C2dm 397 

Canonical robust control problem 314 
Capacitance 21 
Capacitive element 22, 25 
Capacity requirements planning 4 
Car cruise control system 269 
Cartesian co-ordinates 226 
Cascade 65 
Cauchy’s theorem 161 
Central processing unit (CPU) 198 
Centre of area method 335 
Centrifugal speed governor 1 
Chain rule 352 

Characteristic equation 2, 50, 114-116, 120, 
127-128, 131, 138, 220, 227, 230, 
240-241, 260, 262, 264 



Index 435 


Characteristic equation: sampled-data 
system 215 
Chiang 3 
Chromosome 365 
Clf 383 

Clipped fuzzy output window 335-336 
Cloop 385 
Closed form 203 
Closed-loop 6 
bandwidth 224 

characteristic equation 1 14, 252, 265 
control system 63 
damping ratio 126 
dynamics of observed state feedback 
control system 260 
eigenvalues 249,277,280,321,323 
eigenvalues: band dryer 293 
equations 260 

frequency response 172-173, 178, 186, 
189, 225 
modulus 172 
peak magnitude M p 194 
peak M p 189, 191 
poles 118,225,249 

pulse transfer function 209-210, 212, 220 
state equations 261 
system matrix (A - BK) 249 
temperature control system 107 
time-constant 83, 108 
transfer function 63, 107, 194 
transfer function matrix 315 
zeros 118 
Clustering 366 

CNC machine-tool positional control 92 
Co-active ANFIS (CANFIS) 364 
Coefficient of discharge 29, 78 
Cofactor of an element 425 
Co-factors 242 
Cognition subsystem 325 
Combined transfer function 65 
Combining blocks in cascade 67 
Combining blocks in parallel 67 
Command vector \(kT) 282-283 
Command vector v(/) 281 

Compensated modulus crossover 
frequency 190 
Compensator 133 
characteristics 133 
design 133 

design in the frequency domain 178 
gain constant 197 


Competitive learning 347 
Complementary sensitivity function 307 
multivariable system 316 
F(s) (classical control) 301 
T{ s) (internal model control) 302 
7m (ju;) 309 

Complete state feedback 266 
Completing the square 53, 88 
Complex: 

dominant loci 135 
exponential form 145 
frequency approach 147 
plane 119 
quantity 148 
space 148 
variables 2 
zeros 138 

Compressibility effects 77 
Computer numerically controlled (CNC) 
machine tool 3, 8 
Cond 382 

Conditions of uncertainty 325 
Conformal mapping 161 
Conical pendulum 1 
Conjugate 147 
Consequent 330 

Consistent right-hand system of co- 
ordinates 101 
Constant: 

acceleration input 42 
amplitude harmonic forcing 193 
multiplication 38 
position input 41 
velocity 14 
velocity input 42, 107 
Constrained functional minimization 
272 

Continuity equation 31, 77 
Continuous 384 
cycling method 9 1 
solution of the matrix Riccati 
equation 276 
system 225 

-time solution of state equation 245 
-time state transition matrix <j>(t) 269 

Control: 

algorithm 198, 228 
column 7, 8 
engineering 4 
equation 254 
fins 32, 143 



436 Index 


Control: ( continued ) 
input 4, 5 
law 140 
matrix 233 
moment 9 

of an autonomous underwater vehicles 
(AUV) 364 
signal 6, 7, 9, 10 
strategy 140 
surfaces 7, 8 
system 6, 10 
system design 10 
system designer 12 
system toolbox 408, 417 
variable (inverted pendulum) 339 
variables 291 
vector u(t) 248 
weighting matrix R 274 
Controllability 248 
matrix M 248,251,270 
Controllable 248-249 
canonical form 238, 251, 253 
canonical form method 250,251,253 
Controlled variable 4, 5, 12 
Controller 5-7, 10, 93 

emulation (neural network) 361 
transfer function 320 
Controlling device 10 
Conv 385 

Conventional set theory 327 
Convolution integral 38, 239, 242 
Cost function 272 
Course changing 9 
Course-keeping 9, 273 
Covariance matrix 288 
P: band dryer 299 
P(k+\/k+\) 322 
Craven 364 
Create new model 384 
Crisp control signal 335-336 
Crisp set 327 

Critical damping 51-52, 61, 112, 193, 254 
coefficient 5 1 
Crossover point 365 
Cross-sectional area 29-30 
Cross-track: 
error 273 
position error 299 
velocity error 299 
Ctrb 404 
Current 4, 9, 22 


D/A converter 198 

Damped natural frequency 54, 59, 62 

Damping 15-16 

coefficient 17, 19, 33, 61, 193, 267 
element 1 6 

ratio 49, 51-52, 55, 62, 100, 133, 144, 193, 
230, 258, 378 
Dashpot 16, 92 
Data: 

address register 198 
bus 199 

for Nyquist diagram 167 
fusion 325 
dc motor 266 
dc servo-motor 9, 71, 93 
Decibels 151 

Defuzzification process 335 
Degrees-of-freedom 100 
Delay in reward parameter 346 
Delimiter 327 
Delta rule 351, 353-355, 357 
Demanded rudder angle 9 
Dendrites 347 
Derivative action time 90 
Design: 

in the s-plane 132 
of control systems 12 
procedure: lag compensation 190 
Desired: 

closed-loop characteristic equation 
251 

closed-loop eigenvalues 258 
closed-loop poles 231,271 
eigenvalues 262 
heading 9, 101 
set of closed-loop poles 250 
state trajectory r(t) 280 
state vector: band dryer 293 
state vector t(kT) 282 
state vector r(t) 281 
temperature 6-7 
value 4, 6, 10 

value of closed-loop eigenvalues 299 
Det(A) 381 

Determinant of a matrix 425 
Determination of: 

K on root loci 126 
points on root loci 126 
real closed-loop pole 130 
Diagonal matrix 424 



Index 437 


Difference equation 202, 206, 208, 210, 212, 
228-229 

digital compensator 224 
method 205 

Differential equation 2-3, 14, 19, 21, 26, 30, 
32-34, 36, 39, 202 
with constant coefficients 1 5 
Digital: 

circuits 10 

compensator 216, 222-223 
compensator design 220 
compensator design using pole 
placement 224 
compensator types 221 
control system design 198,210 
error signal 8 
feedback signal 8 
format 8 

PID controller 221, 222 
signal 10 

Direct comparison method 250-252, 256, 
258, 265 

Direct construction method 174 
Discrete: 

performance index 282 
quadratic performance index 276, 281 
reverse-time state tracking equation 281, 
283 

solution of the matrix Riccati 
equation 276 

solution of the state equation 276 
system model: band dryer 291 
Discrete-time 200 
compensator 231 
control matrix B( 71 245 
control transition matrix B(7) 270 
response 204, 210 
solution of state equation 244 
state transition matrix A(T) 245, 269 
system 23 1 

unity feedback control system 230 
Discretized universe of discourse 331 
Discriminant 50 
Disturbance: 

attenuation 316 
attenuation factor 316 
effects 12 
input 4-5 

noise covariance matrix Q 287 
noise covariance matrix Q: band 
dryer 297 


rejection 303 

transition matrix Cd(P) 286-287 
transition matrix C ( i(T): band dryer 293 
variables 29 1 
Disturbances 9 
Dominant: 

closed-loop poles 142 
first-order response 134 
Don’t care symbol **’ 370 

Drew 290 
Dreyfus 272 
Dryer: 

clay feed-rate f (t) 289 

model 290 

outlet clay moisture content mf(t) 289 
outlet temperature td(t) 289 
Drying oven 34 
Dummy time variable 239 
Dynamic: 

behaviour 13-14 
characteristics 10, 12, 14 
programming 3, 272 
response 10 
system 35 


Eig(A) 381 
Eigenvalues 255 
Elastic element 15 
Electrical: 
networks 23 
noise 12 

system 13, 21, 25, 27 
Electrohydraulic servovalve 7 
Electromagnetic force 31 
Electrostatic equation 22, 26 
Elements of the Riccati matrix P 280 
Elevator 7-8 
control 7 
Eliminating: 

a feedback loop 67 
a forward loop 67 
Embedded microcontrollers 198 
Empirical approach 91 
Energy output 5 
Engine torque 13 
Envelope of exponential form 110 
Epoch 360 
Equating: 

imaginary parts 128,131,138 
real parts 128,131,138 
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Equation: 

of a circle 173-174 
of motion 18-20 
Equivalent: 

block diagram 67 
damping coefficient 2 1 
mass 94 

moment of inertia 21 
time constant 58-59 
Erasable programmable read only memory 
(EPROM) 198 
Error 7 

back-propagation through plant 
model 361 
coefficients 83 
detector 106 
signal 64 
-actuated system 6 

Estimate x of actual state vector x 254 
Euler-Lagrange equations 272 
Evans 2, 119 
Evolutionary process 365 
Executable machine code 198 
Exhaust pressure 76 
Experimental determination of system time 
constant using step response 46 
Exponential: 
indices 242 
matrix e At 240 
External forces 1 7 
Eye 382 


Factored roots 39 
Feedback 385 
Feedback: 
amplifier 2 
control system 6, 63 
gain matrix: band dryer 292 
path 6 
sensor 10 

Feedforward neural network 349 
Feel simulator 8 
Field: 
coil 33 
constant 74 
control 74 

controlled d.c. motor 33 
controlled dc servo-motor 75-76, 104 
current 33 
File 384 


Filtering effect 256 
Fin: 

positional control system 32, 143 
time constant 135 
Final: 

lead compensator 188 
state x(/) 248 

value theorem 38, 82-84, 168, 212 
Firebrick walls 34 
First-order: 

differential equation 15, 23, 27, 43, 60, 
236 

element 62 
lag systems 153 
lead system 155 
linear system 1 5 
sampled-data system 208 
system 1 8 
type zero system 1 69 
Fismat 422 

Fitness function 365-366, 370, 379 
positional control system 368 
Fixed control strategy 12 
Flow: 
gain 79 

-pressure coefficient 79 
-rate 27 
Fluid: 

damper 33, 61, 104 
systems 27 
Flyball governor 1 
Flywheel 1 9 
Foh 397 

Forms of uncertainty 299 
Forward: 
propagation 356 
speed 13, 28 
speed loss 273 
velocity 4 
Forward-path 6 

transfer function 63, 65, 107 
Fourier 2 
Fourier’s Law 25 

Free-body diagram 17-18, 20, 28, 52 
Frequency: 

of maximum phase advance 196 
of transient oscillation 56 
Frequency domain 2, 145 
analysis 145, 175 
performance specifications 172 
specification 179, 192 
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Frequency response 2 

characteristics: lag compensator 190 
diagram 150 
diagrams 151 
Frictional moment 19 
Full-order: 
observer 258 

state observer 254-255, 260, 271 
Fully connected multilayer network 349 
Function of time 35 
Fuzzification process 331 
Fuzzy 418 
Fuzzy: 

conditional statement 332 
inference 332 
input window 332 
logic 3, 326 
max operation 333 
max-min inference 340 
min operation 333 
output window 334 
relations 330 
rulebase 332, 336, 374 
Fuzzy logic: 
control (FLC) 331 
controller 3, 373 
toolbox 341, 417 
Fuzzy set operations: 
complement 328, 329 
equality 328 
intersection 328, 329 
union 328, 329 
Fuzzy set theory 326-327 
Fuzzy sets 326 


Gain: 

margin (GM) 165-166, 175-178, 184, 
188-189, 196 
reduction 184 
reduction factor 177 
scheduling controller 299-300 
Gas: 

burner 34, 97 
fire 5 

solenoid valve 6, 97 
solenoid valve and burner 10 
Gaussian noise sequence \(k + 1) 286-287 

Gearbox 92-93 
General: 

form of a digital control system 220 


performance index 273 
second-order transfer function 40 
Generalized: 

control problem 81 
second-order system response to a unit 
step input 52 

second-order transfer function 
122 

transfer function 238 
Generic elements 10 
Genetic: 

algorithm (GA) 365 
information 365 
material 365 
structure 365 
Getfis 422 
Global: 

minimum energy state 373 
optimum 365 
Goldberg 365 
Governor 2 

Gradient-descent optimization 351 
Graphical 
addition 151 
user interface (GUI) 384 
Grid 383 
Grimble 3 

Grossberg adaptive resonance theory 
(ART) 350 
Gyro-compass 9, 102 


Ho o 

norm 3, 310 
-control problem 308 
-optimal control 306 
H 2 

-norm 310 

-optimal control problem 305 
Hall chart 174 
Hamiltonian function 272 
Hamilton-Jacobi 
equation 275 

partial differential equation 272 
Harmonic 
input 145 

response diagram 146-148 
Head 29-30 
Heading 4 
error 273, 299 
-rate error 299 
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Heat 26 
flow 25 
loss 7 
sink 26-27 
source 26 
Heave 4 
Hebb 3, 347 
Hebbian learning 347 
Help 382 
Heuristics 365 
Hidden layer 349 
High: 

frequency noise 179 
level language 198 
-frequency (HF) asymptote: first-order 
system 1 53 
-speed jet 7 
Hinfopt 415 
Holland 365 

Hospital operating theatres 7 
Hull 9 

dynamics 101 
transfer function 102 
Human vagueness 3 
Hunting 2 
Hurwitz 2,112 
determinants 1 1 3 
Hydraulic: 
actuators 75 
cylinder 8 
damping ratio 8 1 
gain 8 1 

natural frequency 8 1 
servomechanism 8, 106 
Hydrodynamic resistance 28 

Ideal sampling 201 
Identity matrix 425 
Imaginary axis: 
crossover 126, 128, 131, 138 
crossover point 142 
Imaginary part 148 
Implementation of reduced-order state 
observer 263 
Impulse 383 
Impulse: 
function 41 

response of first-order system 44 
Inductance 21 
Inductive element 22 


Industrial standards rooms 7 
Infinite power series method 204 
Infinity norm 307 
Inflow 29-30 

Information technology (IT) 325 
Infrared absorption analyser 289 
Initial: 

conditions 39 
state x(to) 248 
value theorem 38 
Input: 

function 36 

fuzzy set membership values 
332 

layer 349 
variable 234 
vector 233 
weight 304 
Inputs 4 
Insertion loss 195 
Instability 2 
Instantaneous change 14 
Instruction register 198 
Integral: 

action time 84 
control action 170 
squared error (ISE) 305 
wind-up 91 
Intelligent 

behaviour 325 
control system 3, 325 
Internal model control (1MC) 301, 
361 

International Federation of Automatic 
Control (IFAC) 3 
Inv(A) 381 
Inverse: 

Laplace transforms 242 
model 360 
of a matrix 426 
square law 300 
transform 38, 54, 59, 243 
z-transformation 204 
Inverted: 
pendulum 347 
pendulum system 337 


James Watt 1 
Jang 362 

Johnson 325, 337, 340 
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Jury 215 

stability test 215 
test 218, 230 
Jury’s array 216-217 


Kalman 3, 248, 276, 285 
filter 3, 285, 287-288 
filter design: band dryer 295 
gain 286 

gain matrix K 286-288 
gain matrix K: band dryer 299 
gain matrix K(k + 1) 322 

Kang 362 

Kinematic relationships 2 1 
Knowledge-based systems 326 
Kohonen 3, 347 
self-organizing map (KSOM) 350 


Lag compensator 191 
Laplace 2 

and z-transforms 204 
transform 36, 39, 79, 94, 102, 202 
transform of a time derivative 37 
transform pairs 37-38, 88 
transforms 98, 147, 239-240 
Laser guided missile 32, 143, 182, 222 
Lead: 

compensator 222 
compensator design 183,186 
Lead-lag compensation 92 
Lead-screw 9, 92-93 
Leakage: 

coefficient 78 
flow-rate 77 

Learning rate 353, 360, 377 
Levenber g-Mar quardt back- 
propagation training 423 
Line of constant damping ratio 129, 132 
Linear: 

bearings 3 1 

differential equation 15, 27-28 
displacement transducer 92 
lumped parameter elements 15 
phase-log frequency plot 151 
relationship 14, 29 
systems 2, 1 5 
Linear quadratic: 

Gaussian (LQG) control scheme 288, 
322 


/L-optimal control 305 
regulator (LQR) 274, 288 
tracking problem 280 
Linearity 37 

Linearization of nonlinear functions 27 
Linearize 27 

hydrodynamic resistance 28 
Linearized: 
equation 3 1 
outflow 86 
relationship 30 
spool-valve analysis 78 
valve resistance 29 
Linearly independent 249 
Linear-quadratic-Gaussian (LQG) 
control 3 
Lines of constant: 
settling time 214 
transient frequency 214 
Linguistic label 332 
Liquid-level process control system 85 
Load: 

damping coefficient 106 
flow-rate 76, 79 
moment of inertia 106 
on hydraulic actuator 80 
pressure 76 
Local: 

minima 354 
optima 365 
Log modulus plot 153 
Log modus-log frequency plot 1 5 1 
Logarithmic decrement 56 
Logspace 393 

Low frequency (LF) asymptote 159 
first-order system 153 
Low level language 198 
Low-cost applications 7 
Low-pass filter 179 
LQ control 3 
Lqe 410 
Lqed 411 
Lqr 408 
Lqrd 410 

Luenberger observer 254 
Lyapunov 2 

M and N: 
circles 1 74 
contours 175 
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Machine: 

intelligence 325 
table 8, 9, 93 
Magnetic compass 9 
Magnitude criterion 124,129,132 
Major loop 64 
Mamdani 3, 332 
-type rule 332 

-type rulebase (inverted pendulum) 340 
Mapping: 

closed-loop poles from s to z-plane 226 
from s to z-plane 213 
from s to z-plane 214 
Margin 394 

Marginal stability 9 1 , 1 26, 2 1 8-2 1 9, 3 1 2 
Margins of stability 164 
Mariner Hull 103, 358 
Mass 13,15,17,26 
Master production schedule 3 
Material requirements planning (MRP) 
system 3-4 

Mathematical model 4, 13-15, 21, 25, 27, 
35-36, 55, 254 

MATLAB 109, 133, 161, 341 
command window 
control system toolbox 382 
editor/debugger 383 
fuzzy inference system (FIS) editor 344 
robust control toolbox 320 
toolboxes 380 
Matrix 424 

of multiplicative plant uncertainty 316 
Riccati equation 272, 276, 280, 323 
vector difference equation 245-246 
Matrix operations : 380 

A + B 381 
A* B 381 
A\B 381 
A/B 381 
A' 382 
Max 396 
Maximum: 

closed-loop peak modulus M p 195 
closed-loop peak M p 196-197 
magnitude of weighted sensitivity function 
infinity norm 306 
phase advance <p m 187, 195 
principle 3, 272 
Max-min: 

fuzzy inference 336 
fuzzy reasoning 333 


inference 337 
inference process 333, 335 
Maxwell 2 
McCulloch 347 
Measured: 
elevator angle 7 

open-loop frequency response data 164 
value 6, 10 
Measurement: 
matrix C (7) 287 
noise covariance matrix R 287 
noise covariance matrix R: band 
dryer 295 

vector z(k + 1)7" 287 
Mechanical: 
levers 10 
system 13, 15-17 
Membership function /i 327 
Microcomputers 10 
Microcontroller 198 
Microprocessor control 198 
Mid-frequency (MF) asymptote 155 
Minimum energy control problem 273 
Minimum-time control problem 273 
Minor control loop 9, 64 
Minors 242 

Minors of an element 425 
Mixed-sensitivity cost function 317 
Mksys 416 
Model: 

of a single artificial neuron 348 
of band dryer system 290 
Modulus 145, 147-148, 150-152 
and phase for a first-order system 149 
and phase for a second-order system 1 50 
attenuation 190-191 
crossover frequency 182-184, 186-187, 
191 

Moisture models 290 
Moment of inertia 17, 19, 33, 61, 104, 143, 
267 

Momentum (learning with) 354, 360 

Momentum coefficient 355 

Morse 359 

Motor shaft 20 

Motor vehicle 13-14 

Moving a: 

summing point ahead of a block 67-68 
summing point beyond a block 67 
take-off point ahead of a block 67 
take-off point beyond a block 67 
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^-synthesis theory 3 

Multi-layer perceptron (MLP) 347, 351 

Multiple: 

input, multiple output (MIMO) 
systems 232 
loop systems 64 
Multiplication: 

by a constant 427 
of matrices 427 

Multiplicative uncertainty 303, 306 
Multivariable: 

Hoc robust control 316 
H 2 robust control 316 
loop shaping 317 
robust control 314 
systems 232, 245, 248 
Mutation rate 365 


Networks 23 
Neural network 
state observer 358 
toolbox 417 
Neurofuzzy control 361 
Newff 423 

Newton’s second law of motion 17, 29, 52 
Ngrid 395 
Nichols 395 

Nichols chart 175-178,196-197 
Nichols 2 
Nichols chart: 

lead compensator 184, 188 
uncompensated laser guided missile 183 
Nominal plant model G m (s) 300 
Non-linear 27, 232 
function 27 

Non-singular 248-249, 258 
matrix 426 

Non-zero determinant 248-249 
Normal cross sectional area 25 
Normalized system inputs 304 
N ull matrix 424 
Number of: 

clockwise encirclements 1 62 
distinct root loci 125, 218 
pure integrations in the open-loop transfer 
function 168 

roots with positive real parts 141 
Nyquist 393 
Nyquist 2, 162 
contour 163 


diagram 164-168, 170, 174, 194 
frequency 200 

stability criterion 162,164,306 


Observability 248 
matrix N 248-249, 257, 270 
Observable 248 
canonical form 257, 259 
canonical form method 257, 259 
Observed state variables 260 
Observer: 
design 256 

gain matrix K c 255,257,271 
transient response 256 
Obsv 404 

Offspring chromosomes 365 
Ohm’s Law 22, 26 
On-governors 2 
On-off control 7 
Onset of instability 142 
Open-loop 

characteristic equation 265 
control system 5 
eigenvalues 249, 258 
frequency response data 195 
frequency response locus 176 
frequency response test 194 
gain constant 83, 115, 119, 124, 142 
poles 1 1 9-1 20, 1 27, 1 30, 2 1 9, 249 
pulse transfer function 210, 212, 224, 
229-231 

reduced order characteristic equation 
262 

time constant 108 

transfer function 63-64, 115, 166, 191, 
194, 222 

zeros 119-120, 127, 130, 144, 219 
Operating point 27 
Operational amplifier 179 
Optical pattern recognition 347 
Optimal: 

control law 3,272,275,281 
control law: band dryer 292 
control policy 272 
control problem 272 
control system 272 
feedback matrix K 321 
filter 3 

minimum variance filter 285 
trajectory x(t) 272 
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Optimum: 
design 3 

policy evaluation 326 
Or d2 384 
Orifice theory 78 
Oscillation 7 

Oscillatory second-order response 134 
Other applications of genetic algorithms: 
optimal control 372 
self-organizing fuzzy logic control 372 
Outflow 29-30 
Output: 

equation 234-235, 237-239 
equation (inverted pendulum) 339 
equation: band dryer 291 
error (y — y) 254 
layer 349 
shaft 20 
y(0 248 
Outputs 4 
Overall: 

closed-loop transfer function 64, 66, 68, 
95 

differential equation 3 1 
Overdamped 61 
Overdamping 112 
Overshoot 57, 62 133, 137, 193 


Parabolic: 

fitness function 378 
function 42 
Parallel 385 
Parametric relationship 285 
Parent chromosomes 365 
Partial fraction 39, 47, 53, 88 
expansion 211,242 
Passive 

electrical network 34, 60 
lead compensation 179 
phase lag compensator 189 
PD 133, 179 

cascade compensation 1 79 
compensator 263 
control 92 
controller 331 
Peak: 

closed-loop modulus M p 183 
frequency (w p ) 172 

Peak modulus (M p ) 172, 175-176, 179, 186, 
188 


Percentage overshoot 104, 141, 176, 

193 

Percentage overshoot of first peak 55 
Perception subsystem 325 
Perceptron 347 

Perfect set-point tracking 301-302 
Performance: 
criterion 3, 272 
index 272-273, 321, 351, 354 
index (PI) table 344, 346 
specification 10, 137 
Periodic time 96 
Phase 152 
advance 186 
advance 0 m 182 
angle 147-150 
lag compensation 189 
lead compensation 179 
lead compensation network 195 
lead compensator 284 
margin (PM) 165-166, 175-178, 182-184, 
187-190, 194-196 
relationship 145 
-plane 232 
Physical: 

characteristics 1 3 
laws 10 
system 13-14 
PI 133, 170 
control 85 
control law 84 
Picton 325, 337, 340 
PID 97, 133, 170, 179 
control 138 
control action 89 
controller 108, 289 
controllers for closed-loop systems 
178 

PIDD control 140 

Piece-wise constant function 270 

Pilot 8 

Piston 8 

Pitch 4 

moment of inertia 32 
Pitts 347 
Plant 4-6, 10 

state transition equation 282 
Plot 384 

Pneumatic elements 10 
Polar co-ordinates 148 
plot 147, 150-151 
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Pole: 

angles 123 

locations: s and z-planes 215 
vector magnitudes 124 
Pole/zero cancellation 134 
Pole-zero format 143 
Poly (A) 381 

Pontryagin 3, 272 
Population of chromosomes 365 
Position error coefficient 168 
Positional: 
feedback 106 
servomechanism 268 
Positive feedback 70 
Potentiometer 6 
Power: 

amplifier 93 
series method 206 

Predictive self-organizing fuzzy logic control 
(PSOFLC) 364 
Pressure 27 
difference 8 

-flow-rate characteristics for a 
spool-valve 80 
Price 359 

Primary feedback signal 64 
Principle of optimality 272 
Principle of Superposition 69, 71 
Printsys 383 
Probability 

P of accepting a solution 373 
of selection 365 
theory 326 
Process: 
air 289 
plant 191 
reaction curve 99 
reaction method 90, 108 
Program counter 198 
Programmable read only memory 
(PROM) 198 
Propeller 28, 60 
angular velocity 28 
Proper 387 
Proportional: 
control 7, 82, 137, 142 
control of a first-order plant 82 
controller 133 
controller gain 116 
gain constant 82 
plus derivative (PD) control 92 


plus integral (PI) control 84 
plus integral plus derivative (PID) 
control 89 

Pulse transfer function 206-207, 220 
Pure integrator 138, 158, 170 
asymptote 170 


Quadratic performance index 274-275, 
291 


Ramp 384 
function 36, 42 

response of first-order system 47 
Random 

access memory (RAM) 198 
number generator 367 
Rank 248-249 
Rank 382 
Rank of a matrix 427 
Ratio of successive peaks 99, 109 
RC network 2 
RCL network 235 
Read only memory (ROM) 198 
Readfis 422 
Real: 
part 148 
shift theorem 38 

-time computational complexity 331 
Rearranging summing points 67 
Recent approaches 12 
Rechenburg 365 
Recommended compensator 135 
Rectangular plot 150,175 
Recursive: 

discrete-time simulation 245 
steps 246 
Reduced: 

block diagram 69 
matrix Riccati equation 276, 321 
observer system 266 
Riccati equation 278 
second-order state observer 264 
-order observer gain matrix K c 262 
-order state observer 254, 262, 266, 271 
Reduction gearbox 19 
Regeneration Theory 2 
Regulator 254 
control problem 273 
regulator problem 273 
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Relationship between 

<j> m and the spacing of 1 /T\ and 1/T 2 182 

frequency response and time response: 

closed-loop systems 191 
open-loop and closed-loop frequency 
response 172 
Relative modulus 156 
Relocfind 390 
Removing a block from a 
feedback loop 67 
forward path 67 
Repeated roots 39 
Resistance 13, 21 
thermometer 6, 58 
Resistive element 22, 25 
Resolution 10, 198 
Reverse-time: 
recursive process 277 
state tracking equations 280 
Riccati matrix: 
band dryer 292 
P 277, 279, 288 
P(kT) 282 
Richter 358, 364 
Rise time 57, 104, 141, 176 
Rlocus 389 
Robust: 
control 3 

control problem 299 
control toolbox 408 
design 3 

multivariable control system design 316 
performance 300, 308-309, 312-313 
stability 300, 306-307, 311-313, 324 
Roll 4 
dynamics 137 

Room temperature control system 6 
Root locus: 
analysis: z-plane 218 
asymptotes 125 
construction rules 125 
construction rules: z-plane 218 
locations on real axis 126,218 
method 119 
diagram 1 1 9 
Roots 381 
Roots: 

of characteristic equation 2, 49, 51, 

112, 118, 120-122, 126, 163, 218, 
241-242 

with positive real parts 1 14 


Rosenblatt 3, 347 
Rotation about yaw axis 101 
Rotational: 
damper 1 6 
spring 16 
1 system 1 7 

Roulette wheel selection 365 
Routh 2, 1 12 
stability criterion 166-167 
Routh’s array 113, 116, 128, 167 
special cases: a zero in the first 
column 117 

special cases: all elements in a row are 
zero 1 1 7 

Routh-Hurwitz stability criterion 113, 126, 
141,215 
Rudder 9-10 
activity 273 
angle 101 
angle sensor 9 
Rule-of-thumb 58, 91, 200 
Rumelhart 347 
Rzevski 3 


S domain 36 

algebraic equations 36 
Safanov 3 

Sampled-data system 204 
Sampling: 

frequency (tu s ) 200, 214, 222, 
224 

period T 198 
time T 201, 225 
Satellite control 273 
Save as 384 
Schema 370 
Schemata 370 
Scope 384 
Script files 382-383 
Second-order: 
complex roots 39 
differential equation 15, 24-25 
element 62 
linear system 1 5 
real roots 39 
system 18, 58, 170, 280 
system closed-loop frequency 
response 1 72 
transfer functions 61 
type one system 169 
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Selection of: 

parents for mating 367 
performance index 273 
Self-organizing fuzzy logic control 
(SOFLC) 344 
Semilogx 393 
Sensitivity function 
multivariable system 3 1 5 
S(s) (classical control) 301 
S(s) (internal model control) 302 
S m CM 308 
Sensor 5-6 
array 325 
Series 385 
Servomechanism 7, 107 
Servomotor 9 
Set heading 9 
Set of: 

differential equations 272 
first-order differential equations 233, 235 
Set-point tracking 303 
Settling time 57^ 96, 104, 133, 137, 141, 176, 
191, 193 

Several inputs acting simultaneously 69 
Sgrid 390 
Shaft encoder 8-9 
Shannon’s sampling theorem 200 
Ship 28, 60 
autopilot 100 

autopilot control system 9, 102 
roll damping ratio 137 
roll natural frequency 135 
roll stabilization system 135, 270 
steady-state gain 137 
Sigma 416 
Sigmoid: 

activation function 354 
function 352 
Signal: 

processing 325 
take-off point 64 
Simplified Nyquist stability criterion 
164 

Simulated annealing 373 
Simulation 384 
SIMULINK 341, 380, 384 
library browser 384 
Simultaneous equations 59 
Single input, single output (SISO) 
systems 232 

Single neuron summation 354 


Single-layer fully-connected recurrent 
network 350 
Singular 249 
matrix 426 
value loop shaping 3 1 5 
values of a complex matrix 3 1 5 
Sinks 384 
Slope: 

— 12dB per octave (— 40 dB per 
decade) 155 

— 6dB per octave (— 20 dB per 
decade) 153, 158 

Small: 

gain infinity-norm control problem 
316 

perturbation theory 28 
perturbations 27, 79 
perturbations of spool valve and 
actuator 75 
Smith 347 
Solenoid valve 3 1 
Solution: 

of the state vector differential 
equation 239 
space 369 
Sources 384 
Specific: 

heat at constant pressure 26 
inputs 304 
Specification 96 
Speed: 

control system 104 
of convergence 370 
Spool-valve: 

controlled linear actuator 75-76 
movement 7 
Spring stiffness 16 

Spring-mass-damper system 17-18,51, 193, 
234, 241-242, 245 
Square 390 
ss_g 416 
Ss2tf 402 
Stability 2 
criteria 2 

in the frequency domain 161 
in the z-plane 213 
of a closed-loop system 114 
on the Bode diagram 170-171 
Stabilize 9 

Stable and unstable time responses 1 1 1 
Stable systems 110 
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Standard: 
components 39 

form of transfer function for a first-order 
system 44 

forms of transfer functions for a second- 
order system 49 
methodology 12 
Start 384 

Starting point 125, 218 
State equation 235-239, 241, 252, 233 
(inverted pendulum) 339 
State equations: 
band dryer 291 
from transfer functions 238 
State feedback: 

gain matrix 249,251 
gain matrix K(kT) 282 
matrix 250 

matrix (inverted pendulum) 340 
matrix K 277, 279 
State: 

estimation 284 
observer 254, 261 
of a system 232-233 
trajectory 242-244 
State variable: 

step response 244 
time response 243 

State variables 232-236, 238, 242, 244, 254, 
291 

inverted pendulum 339 
State vector 233 
differential equation 233, 240 
x(kT) 282 

State weighting matrix Q 274 
State-space 232 
approach 232 
formulation 3 

representation of controller 320 
State-transition matrix 240 
Static characteristics 10 
Steady-state: 

error 36,48,62,81,108,132 
error coefficients 168 
gain 52 

gain constant 44, 49, 62 
period 36 
response 35 
terms 110 

Steam mass flow-rate 1 
Steering gear 9-10,101 


Step 383 
Step: 

function 41 
input function 62 
Step response 137, 220 
analysis 55 
function 55 
of first-order system 45 
performance specification 57 
Stiffness 15,33,61 
Structured model uncertainty 303 
Subplot 397 
Sugeno 3, 362 
Summation of 
log modulus 153 
phase 153 
system elements 1 52 
Summed squared error function 351 
Summing 
point 6 

point symbol 64 
Supervised 
learning 350 

learning in neural networks 326 
Supply pressure 76 
Survival of the fittest 365 
Sutton 3 

Symmetric matrix 425 
Symmetry of root loci 125, 218 
Synapses 347 
Synaptic reaction 347 
System 4 

covariance matrix P 286 
dynamics 15, 35 

frequency domain performance 189 
inputs 236 
matrix 233 
outputs 236 
performance 141 
response 4, 36 
System type: 

and steady-state errors 168 
classification 83, 85, 168-169 
Systems with multiple inputs 69 


Tabu search 373 
Tachogenerator 9, 95, 104 
Takagi 362 
Temperature 5 
control 7 
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control system 97 
differential 25 
rise 26 
Term: 

(k/k) 286 
(k + 1 /k) 286 
(k+l/k+1) 286 
Terminal control problem 272 
Termination point 125, 218 
Tf 2ss 402 
Thermal: 

capacitance 26, 34, 97, 108 
conductivity 25 
dynamics of room 97 
resistance 26, 34, 108 
resistance of walls 98 
systems 25 
Thermocouple 6 
Thermometer 98, 108 
Thermostatic control 7 
Thickness 25 
Third-order: 

differential equation 1 5 
linear system 15 
transient response 59 
type two system 169 
Three-term control action 89 
Time constant 44, 48, 59, 60, 62 
Time domain 35, 36 
analysis 35 

differential equations 36 
performance specifications 172 
Time invariant 232 
Time response 35-36, 59, 60, 62, 191 
of burner temperature: band dryer 
295 

of gas-valve angle: band dryer 294 
of higher-order systems 58 
Time-variant 12, 232 
Tolerance band 193 
Tong 3 

Torsional spring 33, 61 
Total fitness of: 
offsprings 367 
population 367 
Total response 36 
Trace of a matrix 427 
Tracking 

control problem 273 
vector s(t) 28 1 
Train 423 


Training 
data 358 
file 359 

Transfer fen 384 
Transfer function 39-40, 60, 62 
approach 41, 63 
Transformation matrix T 250 
Transient: 

analysis of discrete systems 213 
errors 36, 81 
period 36, 58 
response 35, 242 

response of a second-order system 50 
terms 110 

Transition matrix <f>( s) 247 
Translational: 
damper 16 
spring 1 5 
system 1 7 

Transportation lag 90 
Transpose of a matrix 425 
Trial point 144 
TSS_ 416 

Turbulent flow conditions 27 

Tustin 397 

Tustin’s rule 222, 223 

Two degree-of-freedom IMC system 302 

Two-mass system 237 

Two-port state-space representation 314 

Type number 168 


Ultimate: 
gain 91 
period 91 

Undamped natural frequency 49, 52, 62, 
193, 258 

Underdamped 61,112 
second-order system 55 
Unit circle 214,218 
crossover 218-219, 230 
Unit impulse 41 
function 201 

Unit parabolic function 42 
Unit ramp 48 
function 42, 208-247 
Unit step: 

function 37, 41 
input 52, 62 
response 54, 60-61 
response function 58 



450 Index 


Unity feedback: 
computer control system 230 
continuous control system 230 
control system 196 
Unity gain second-order system 62 
Universe of discourse U 327, 332 
Unstable systems 110 
Unstructured model uncertainty 303 
Unsupervised 
learning 350 

learning in neural networks 326 


Valve 58 
flow area 29 

Variance of the weighted mean P 285 
Variational calculus 272 
Vector 424 

of measurements z(k +1)7’ 286 
Vehicle 14 
model 14 
Velocity 16 

error coefficient 1 69 
feedback 92, 106 
Vessel 9 
Voltage 22 

Volume of hydraulic fluid 76 
Volumetric 
flow-rate 29 
strain 77 
stress 77 


Walking beam feedback linkage 106 

Wall 26 

Watt governor 1 

Waves 4 , 9 

Weighted 

mixed-sensitivity approach 3 1 7 


sensitivity function 310,312 
summer 348 

Weights and biases 357-358, 376-377 

Werbos 347 

Wheel traction force 13 

While 396 

Who 386 

Whos 386 

Widrow 347 

Widrow-Hoff 3 

Wiener 3, 284 

Wind 4, 9 


Xlabel 393 


Yaw hydrodynamics coefficients 
101 


Zadeh 3 
Zero: 

angles 123 
determinant 249 
modulus crossover 183 
steady-state error 137 
vector magnitudes 124 
-order hold 201,202 
Zgrid 399 
Ziegler-Nichols 99, 108 
methods 90 
Z oh 397 
Z-plane 217, 220 

characteristic equation 226 
Z-transform 202 

theorems: initial value theorem, final value 
theorem 204 
theorems: linearity 203 



